-- Logs begin at Tue 2022-09-13 11:31:22 UTC, end at Tue 2022-09-13 12:30:49 UTC. -- Sep 13 12:02:41.093240 dv-osbrick-857347-1-ceph systemd[1]: Starting Devstack devstack@keystone.service... Sep 13 12:02:41.100904 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 13 12:02:41.105304 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 12:02:41 2022] *** Sep 13 12:02:41.105304 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 12:02:41.105304 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 12:02:41.105304 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: nodename: dv-osbrick-857347-1-ceph Sep 13 12:02:41.105304 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: machine: x86_64 Sep 13 12:02:41.105304 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: clock source: unix Sep 13 12:02:41.105304 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: pcre jit disabled Sep 13 12:02:41.105304 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: detected number of CPU cores: 4 Sep 13 12:02:41.105304 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: current working directory: / Sep 13 12:02:41.105304 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: detected binary path: /usr/bin/uwsgi-core Sep 13 12:02:41.105304 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: your processes number limit is 47680 Sep 13 12:02:41.105304 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: your memory page size is 4096 bytes Sep 13 12:02:41.105304 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: detected max file descriptor number: 2048 Sep 13 12:02:41.105304 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: lock engine: pthread robust mutexes Sep 13 12:02:41.105304 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: thunder lock: enabled Sep 13 12:02:41.105304 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 13 12:02:41.105304 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 12:02:41.148673 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: Python main interpreter initialized at 0x55f65a1379c0 Sep 13 12:02:41.148673 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: python threads support enabled Sep 13 12:02:41.148673 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: your server socket listen backlog is limited to 100 connections Sep 13 12:02:41.148673 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: your mercy for graceful operations on workers is 90 seconds Sep 13 12:02:41.149725 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 12:02:41.149946 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: *** Operational MODE: preforking *** Sep 13 12:02:41.150222 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: *** uWSGI is running in multiple interpreter mode *** Sep 13 12:02:41.150222 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: spawned uWSGI master process (pid: 88345) Sep 13 12:02:41.150429 dv-osbrick-857347-1-ceph systemd[1]: Started Devstack devstack@keystone.service. Sep 13 12:02:41.151566 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: spawned uWSGI worker 1 (pid: 88356, cores: 1) Sep 13 12:02:41.151566 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: spawned uWSGI worker 2 (pid: 88357, cores: 1) Sep 13 12:02:41.151566 dv-osbrick-857347-1-ceph devstack@keystone.service[88345]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 12:02:45.871365 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 12:02:45.871365 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: from cryptography.utils import int_from_bytes Sep 13 12:02:45.872181 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 12:02:45.872181 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: from cryptography.utils import int_from_bytes Sep 13 12:02:45.873846 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 12:02:45.873846 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: from cryptography.utils import int_from_bytes Sep 13 12:02:45.874300 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 12:02:45.874300 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: from cryptography.utils import int_from_bytes Sep 13 12:02:45.925039 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 12:02:45.925267 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 12:02:45.925402 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] command line args: [] {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 12:02:45.925566 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 12:02:45.925704 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 12:02:45.925827 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ================================================================================ {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 12:02:45.925945 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 12:02:45.926072 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] admin_token = **** {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.926205 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] command line args: [] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 12:02:45.926332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] config_dir = [] {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.926445 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 12:02:45.926554 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.926681 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ================================================================================ {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 12:02:45.926767 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] config_source = [] {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.926845 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] admin_token = **** {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.926922 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] debug = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.926994 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] config_dir = [] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.927070 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.927352 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.927352 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] config_source = [] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.927633 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.927763 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] debug = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.927868 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.928003 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.928142 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.928241 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.928335 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.928444 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.928539 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] list_limit = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.928645 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.928745 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] log_config_append = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.928851 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.928952 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.929046 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] list_limit = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.929139 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] log_dir = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.929244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] log_config_append = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.929346 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] log_file = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.929455 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.929532 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.930439 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] log_dir = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.930526 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.930626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] log_file = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.930717 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.930837 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.930924 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.931050 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.931130 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.931130 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.931321 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.931441 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.931522 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.931638 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.931722 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.931824 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.931948 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.932029 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.932155 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.932232 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.932358 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.932435 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.932566 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.932642 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.932751 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.932904 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.932994 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.932994 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.933186 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.933262 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.933338 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.933458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.933631 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] publish_errors = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.933725 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.933798 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.934020 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.934113 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.934194 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.934311 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] publish_errors = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.934435 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.934569 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.934705 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.934835 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.934928 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.935010 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] standard_threads = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.935116 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.935197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.935348 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.935434 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.935556 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.935686 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] standard_threads = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.935761 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] use_journal = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.935837 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.935913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] use_json = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.936020 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.936104 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] use_stderr = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.936182 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.936249 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] use_syslog = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.936357 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] use_journal = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.936434 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.936531 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] use_json = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.936690 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.936780 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] use_stderr = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.936852 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] use_syslog = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.936926 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.937077 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 12:02:45.937185 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.937331 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.937417 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.937567 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.937645 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.937967 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.938061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.938122 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.938187 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.938293 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.938361 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.938528 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.938594 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.938782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.938860 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.939021 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.939107 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.939266 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.939344 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.939511 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.939599 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.939756 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.939834 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.939987 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.940065 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.940230 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.940325 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.940462 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.940546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.940706 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.940783 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.940949 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.941103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.941182 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.941259 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.941419 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.941501 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.941669 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.941753 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.941911 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.941988 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.942143 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.942219 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.942394 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.942480 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.942661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.942743 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.942881 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.942958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.943114 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.943193 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.943353 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.943436 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.943584 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.943660 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.943812 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.943890 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.944044 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.944122 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.944278 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.944355 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.944521 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.944599 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.944749 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.944826 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.944975 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.945053 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.945315 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.945913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.946152 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.946231 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.946450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.946605 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.946766 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.946929 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.947015 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.947167 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.947245 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.947402 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.947550 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.947624 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.947695 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.947859 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.947935 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.948089 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.948175 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.948319 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.948397 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.948548 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.948626 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.948779 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.948864 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.949021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.949099 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.949247 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.949329 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.949482 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.949571 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.949711 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.949790 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.949944 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.950049 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.950200 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.950317 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.950420 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.950518 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.950669 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.950772 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.950920 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.951009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.951082 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.951235 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.951315 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.951499 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.951584 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.951741 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.951826 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.951971 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.952054 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.952205 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.952352 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.952471 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.952590 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.952713 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.952826 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.952948 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.953057 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.953190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.953320 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.953430 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.953555 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.953706 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.953785 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.953950 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.954082 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.954203 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.954281 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.954455 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.954533 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.954718 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.954814 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.954961 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.955041 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.955200 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.955278 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.955444 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.955529 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.955677 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.955762 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.955911 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.955989 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.956155 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.956245 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.956389 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.956466 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.956624 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.956708 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.956865 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.956951 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.957098 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.957175 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.957333 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.957410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.957568 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.957653 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.957803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.957880 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.958036 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.958113 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.958307 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.958405 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.958503 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.958651 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.958790 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.958902 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.959030 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.959186 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.959262 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.959375 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.959505 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.959605 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.959740 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.959980 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.960108 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.960199 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.960354 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.960432 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.960588 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.960666 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.960856 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.961008 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.961116 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.961248 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.961364 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.961545 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.961677 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.961792 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.961993 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.962072 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.962230 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.962308 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.962473 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.962553 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.962743 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.962825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.962994 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.963073 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.963232 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.963314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.963472 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] auth.external = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.963558 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.963708 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.963797 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.963964 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.964043 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.964197 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] auth.external = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.964284 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.964426 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.964505 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] auth.password = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.964665 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] auth.token = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.964743 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.964910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.964990 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.965150 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.965230 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] auth.password = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.965377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] auth.token = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.965455 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.965613 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.965694 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.965847 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.965925 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.966091 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.966176 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.966321 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.966403 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.966557 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] credential.caching = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.966708 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.966830 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.966908 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.967060 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.967141 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.967293 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] credential.caching = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.967372 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.967540 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.967619 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.967787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.967863 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.968024 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.968101 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.968274 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.968363 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.968515 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.968596 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.968748 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.968826 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.968992 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.969071 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.969243 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.969324 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.969479 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.969559 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.969729 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.969808 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.970012 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.970093 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.970257 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.970335 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.970517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.970607 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] federation.caching = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.970780 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.970861 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.971031 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.971110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.971264 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] federation.caching = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.971342 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.971500 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.971581 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.971745 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.971826 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.971980 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.972058 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.972206 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.972359 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.972446 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.972526 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.972671 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.972750 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.972919 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.973000 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.973152 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.973232 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.973389 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] identity.caching = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.973542 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.973619 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.973691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.973863 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.973943 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.974095 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.caching = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.974182 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.974328 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.974504 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.974586 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.974718 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.974802 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.974885 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.975039 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.975120 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.975285 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.975364 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.975513 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.975821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.975911 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.975985 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.975985 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.976117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.976190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.976270 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.976443 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.976531 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.976697 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.976830 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.977087 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.977174 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.977348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.977490 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.977599 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.977744 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.977960 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.978048 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.978207 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.978286 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.978448 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.978527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.978712 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.978809 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.978953 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.979035 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.979186 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.979265 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.979412 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.979498 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.979646 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.979726 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.979875 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.979955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.980108 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.980196 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.980341 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.980420 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.980577 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.980665 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.980822 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.980910 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.981050 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.981129 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.981295 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.981373 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.981536 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.981623 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.981766 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.981845 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.982008 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.982087 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.982241 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.982337 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.982467 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.982545 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.982725 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.982806 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.982954 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.983052 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.983194 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.983300 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.983429 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.983508 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.983666 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.983754 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.983899 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.983980 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.984133 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.984212 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.984366 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.984455 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.984616 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.984696 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.984866 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.984955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.985092 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.985186 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.985327 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.985412 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.985565 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.985652 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.985795 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.985875 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.user = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.986027 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.986107 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.986260 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.986339 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.986491 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.986580 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.986751 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.986833 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.987001 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.987079 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.987227 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.987308 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.987471 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.987552 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.987702 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.987780 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.987939 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.988021 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.988175 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.988292 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.988413 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.988494 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.988649 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.988793 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.988923 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.989007 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.989116 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.989194 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.989347 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.989429 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.989588 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.989696 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.989821 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.989951 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.990094 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.990222 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.990347 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.990474 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.990672 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.990796 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.990933 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.991024 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.991086 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.991207 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.991374 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.991452 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.991697 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.991811 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.991924 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.992609 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.992747 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.993018 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.993108 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.993184 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.993256 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.993473 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.993630 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.993709 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.993890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.993970 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.994133 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.994211 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.994390 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.994468 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.994637 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.994720 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.994881 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.994959 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.995117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.995194 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] resource.caching = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.995351 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.995431 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.995586 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.995664 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.995831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.995909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.996071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.996151 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.996301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.996379 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.996536 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.996614 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.996775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] resource.caching = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.996860 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.997011 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.997088 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.997252 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.997330 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.997468 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.997542 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] role.caching = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.997717 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.997796 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] role.driver = sql {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.997947 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.998025 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.998181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.998260 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.998426 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.998504 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.998695 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.998781 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.998931 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.999011 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.999162 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] role.caching = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.999240 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.999409 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] role.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.999495 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.999638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.999716 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.999884 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:45.999963 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.000120 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.000205 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.000363 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.000440 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.000605 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.000725 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.000857 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.000947 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.001103 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.001181 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.001345 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.001562 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.001656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.001781 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.001862 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.002035 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.002113 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.002275 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.002352 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.002519 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.002598 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.002788 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.002872 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.003048 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.003215 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.003316 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.003452 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.003531 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.003700 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.003779 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.003949 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.004035 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.004185 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.004264 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.004420 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.004498 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.004649 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.004731 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.004901 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.004979 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.005152 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.005230 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.005388 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.005466 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.005616 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.005692 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.005844 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.005920 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.006071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.006149 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] token.caching = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.006305 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.006382 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.006555 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.006664 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.006820 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.006900 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.007053 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.007130 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.007285 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.007363 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.007511 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.007590 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.007820 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] token.caching = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.008431 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.008654 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.008733 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.008942 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.009110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.009249 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.009374 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.009520 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.009632 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.009761 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.009880 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.010016 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.010117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.010300 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.010378 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.010536 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.010648 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.010808 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.010892 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.011080 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.011158 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.011312 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.011389 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] database.connection = **** {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.011543 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.011623 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.011788 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.011866 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.012052 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.012137 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.012279 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.012365 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.012518 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.012605 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.012755 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.012832 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.012995 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.013080 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.connection = **** {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.013234 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.013317 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.013482 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.013561 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.013715 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.013800 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.013954 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.014033 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.014186 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.014265 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.014421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.014508 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.014677 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.014760 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.014911 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.014990 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.015145 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.015237 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.015377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.015455 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.015614 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.015692 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.015787 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 12:02:46.015874 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.016078 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.016312 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.016555 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.016783 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.017020 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.017251 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 12:02:46.017419 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 12:02:46.045824 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.046050 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.046277 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.046716 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.046950 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.047179 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.056219 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.056908 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.084984 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.085213 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.085308 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.085540 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.139976 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.140174 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.189547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.189720 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.190070 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.190308 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.256733 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.256941 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.257031 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.257109 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.257186 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.257262 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.257346 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.257483 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.257568 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.258283 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.258376 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.258647 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.282107 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.282246 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.282344 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.282429 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.282570 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.282700 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.282822 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.282906 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.283019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.283102 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.283233 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.283316 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.283445 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.283527 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.295619 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.295785 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.308825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.309057 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.309185 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.309269 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.309415 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.309499 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.309637 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.309720 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.309857 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.309940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.310074 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.310159 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88356) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.310287 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.310497 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 12:02:46.327009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.327134 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.327215 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 12:02:46.327330 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 12:02:46.327557 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.327668 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.327750 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 12:02:46.327869 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 12:02:46.328026 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.328145 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.328291 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.328406 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.328555 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.328664 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.328816 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.328921 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.338428 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.338735 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.338916 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.339000 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.339195 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.339277 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.339466 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.339750 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.346355 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.346820 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.349275 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.349561 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.349728 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.349850 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.350010 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.350139 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.350298 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.350429 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.350585 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.350720 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.350899 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.350979 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.351160 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.351253 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.351986 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.352151 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.352397 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.352479 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.352677 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.352804 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.353052 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.353329 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.376421 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.377091 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.377894 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.378181 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.378548 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.378858 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.383087 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.383387 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.383705 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.383991 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.385284 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.385890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.391973 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.392280 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.392563 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.392850 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.396348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.396641 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.396808 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.396929 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.397095 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.397327 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.397411 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.397613 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.397755 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.397906 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.398034 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.398203 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.398337 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.398550 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.398778 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.399219 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.415120 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.415403 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.415501 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.415759 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.419560 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.419898 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.422999 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.423126 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.423400 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.423487 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.427610 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.427704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.431403 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.431724 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.434510 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.434832 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.434920 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.435118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.435203 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.435403 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.435533 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.435798 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.435889 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.436086 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.436171 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.436373 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.452169 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.452413 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.452497 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.452685 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.452768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.452955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.453039 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.453279 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.459808 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.460016 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.461508 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.461970 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.463079 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.463373 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.463566 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.463841 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.466305 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.466466 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.466598 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.466785 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.466917 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.467071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.467209 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.467352 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.467492 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.467638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.479489 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.479776 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.479873 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.480063 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.480147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.480356 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.480449 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.480646 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.480731 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.480930 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.481012 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.481216 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.481342 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.481488 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.497797 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.497951 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.500871 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.500987 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.503814 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.503922 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.505257 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.505356 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.506752 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.506840 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.507041 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.507124 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.507339 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.507421 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.513927 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.514307 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.515444 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.515789 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.518416 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.518669 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.518823 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.518961 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.519045 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.519245 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.519327 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.519519 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.527523 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.527821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.527903 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.528109 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.528205 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.528409 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.536082 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88356) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.536278 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 12:02:46.536361 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.536561 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.536651 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.536841 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.536923 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.537117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.537198 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.537398 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.537479 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.537670 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.537759 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.537944 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.538027 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.538212 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.538291 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.538487 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.538574 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.538777 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.539355 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.539578 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.539686 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.539850 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.540114 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88356) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.540205 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.540385 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.540651 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 12:02:46.574568 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f65a1379c0 pid: 88356 (default app) Sep 13 12:02:46.574882 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f65a1379c0 pid: 88357 (default app) Sep 13 12:02:46.578956 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a76769-14b6-4ca8-a941-1b7ec5fac959 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:46.579252 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a76769-14b6-4ca8-a941-1b7ec5fac959 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:46.579530 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a76769-14b6-4ca8-a941-1b7ec5fac959 None None] PATH_INFO: `/v3` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:46.583696 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Tue Sep 13 12:02:46 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:53.961184 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263e85b-0a34-4fc8-94e1-5977857a4c02 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:53.961681 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263e85b-0a34-4fc8-94e1-5977857a4c02 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:53.961681 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263e85b-0a34-4fc8-94e1-5977857a4c02 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:53.965913 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:02:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:02:53.971639 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdbb2c-bd03-44d0-a845-d155c069e543 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:53.972197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdbb2c-bd03-44d0-a845-d155c069e543 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:53.972197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdbb2c-bd03-44d0-a845-d155c069e543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:54.049790 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: INFO dbcounter [None req-dbcdbb2c-bd03-44d0-a845-d155c069e543 None None] Registered counter for database keystone Sep 13 12:02:54.069162 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG oslo_db.sqlalchemy.engines [None req-dbcdbb2c-bd03-44d0-a845-d155c069e543 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88356) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 12:02:54.075506 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writer thread running {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 12:02:54.255319 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG passlib.handlers.bcrypt [None req-dbcdbb2c-bd03-44d0-a845-d155c069e543 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88356) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 12:02:54.255648 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG passlib.handlers.bcrypt [None req-dbcdbb2c-bd03-44d0-a845-d155c069e543 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88356) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 12:02:54.313693 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-dbcdbb2c-bd03-44d0-a845-d155c069e543 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:54.315323 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-dbcdbb2c-bd03-44d0-a845-d155c069e543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:54.446455 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 13 12:02:54.979025 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263e85b-0a34-4fc8-94e1-5977857a4c02 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:55.055950 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: INFO dbcounter [None req-d263e85b-0a34-4fc8-94e1-5977857a4c02 None None] Registered counter for database keystone Sep 13 12:02:55.077894 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG oslo_db.sqlalchemy.engines [None req-d263e85b-0a34-4fc8-94e1-5977857a4c02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 12:02:55.084175 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writer thread running {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 12:02:55.204504 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263e85b-0a34-4fc8-94e1-5977857a4c02 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:55.208847 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c6694-9843-4bf2-81d2-14c30d1b947a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:55.209469 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c6694-9843-4bf2-81d2-14c30d1b947a admin admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:55.209775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c6694-9843-4bf2-81d2-14c30d1b947a admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:55.210105 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c6694-9843-4bf2-81d2-14c30d1b947a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:55.218961 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c6694-9843-4bf2-81d2-14c30d1b947a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:55.270717 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2d5c6694-9843-4bf2-81d2-14c30d1b947a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 12:02:55.271001 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c6694-9843-4bf2-81d2-14c30d1b947a admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:55.280698 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Tue Sep 13 12:02:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 12:02:55.286813 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdbb2c-bd03-44d0-a845-d155c069e543 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:55.305139 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdbb2c-bd03-44d0-a845-d155c069e543 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:55.309648 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fdf45-276b-44ce-b38c-7c492b54851e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:55.310776 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fdf45-276b-44ce-b38c-7c492b54851e admin admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:55.311064 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fdf45-276b-44ce-b38c-7c492b54851e admin admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:55.311339 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fdf45-276b-44ce-b38c-7c492b54851e admin admin] PATH_INFO: `/v3/projects/99ef8d30db4a4918b2622d7bdad47c3e` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:55.315126 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fdf45-276b-44ce-b38c-7c492b54851e admin admin] RBAC: Authorizing `identity:get_project(project_id=99ef8d30db4a4918b2622d7bdad47c3e)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:55.364977 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: WARNING keystone.common.rbac_enforcer.enforcer [None req-406fdf45-276b-44ce-b38c-7c492b54851e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 12:02:55.365314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406fdf45-276b-44ce-b38c-7c492b54851e admin admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:55.370465 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Tue Sep 13 12:02:55 2022] GET /identity/v3/projects/99ef8d30db4a4918b2622d7bdad47c3e => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:02:57.770243 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890efffe-11de-4900-8e94-10bef25957f5 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:57.770819 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890efffe-11de-4900-8e94-10bef25957f5 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:57.770819 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890efffe-11de-4900-8e94-10bef25957f5 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:57.775606 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:02:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:02:57.781002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af9f8c-2a44-4525-870d-eaf42bc892aa None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:57.781430 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af9f8c-2a44-4525-870d-eaf42bc892aa None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:57.781548 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af9f8c-2a44-4525-870d-eaf42bc892aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:57.801667 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-c9af9f8c-2a44-4525-870d-eaf42bc892aa None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:02:57.803385 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-c9af9f8c-2a44-4525-870d-eaf42bc892aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:02:57.811264 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:02:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 13 12:02:58.130266 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890efffe-11de-4900-8e94-10bef25957f5 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:58.143039 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890efffe-11de-4900-8e94-10bef25957f5 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:58.147837 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73913410-cce3-4911-9498-fa790c0adfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:58.148430 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73913410-cce3-4911-9498-fa790c0adfe7 admin admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:58.148711 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73913410-cce3-4911-9498-fa790c0adfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:58.148986 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73913410-cce3-4911-9498-fa790c0adfe7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:58.156594 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73913410-cce3-4911-9498-fa790c0adfe7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:58.158369 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73913410-cce3-4911-9498-fa790c0adfe7 admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:58.167391 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Tue Sep 13 12:02:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 12:02:58.172816 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af9f8c-2a44-4525-870d-eaf42bc892aa None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:02:58.182069 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af9f8c-2a44-4525-870d-eaf42bc892aa None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:02:58.186419 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952d541-0891-4928-8b47-85f0c18c1897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:02:58.187075 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952d541-0891-4928-8b47-85f0c18c1897 admin admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:02:58.187359 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952d541-0891-4928-8b47-85f0c18c1897 admin admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:02:58.187632 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952d541-0891-4928-8b47-85f0c18c1897 admin admin] PATH_INFO: `/v3/users/e8c852aa86d546e6891e0dac7b3ec7f8` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:02:58.188959 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952d541-0891-4928-8b47-85f0c18c1897 admin admin] RBAC: Authorizing `identity:get_user(user_id=e8c852aa86d546e6891e0dac7b3ec7f8)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:02:58.190813 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952d541-0891-4928-8b47-85f0c18c1897 admin admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:02:58.192325 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Tue Sep 13 12:02:58 2022] GET /identity/v3/users/e8c852aa86d546e6891e0dac7b3ec7f8 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:00.700772 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88ec31-bea2-4a9e-a076-b8b491a71662 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:00.701276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88ec31-bea2-4a9e-a076-b8b491a71662 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:00.701378 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88ec31-bea2-4a9e-a076-b8b491a71662 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:00.702667 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:00.708086 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf1d93-46b3-46f2-9591-70df0f45a902 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:00.708495 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf1d93-46b3-46f2-9591-70df0f45a902 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:00.708642 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf1d93-46b3-46f2-9591-70df0f45a902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:00.713941 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4fada-7f46-4fef-af8a-2e2ae4c0fd77 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:00.714230 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4fada-7f46-4fef-af8a-2e2ae4c0fd77 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:00.714504 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4fada-7f46-4fef-af8a-2e2ae4c0fd77 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:00.715783 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:03:00.720707 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509585a-6429-468e-bb10-4ad7cc8ceb83 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:00.720999 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509585a-6429-468e-bb10-4ad7cc8ceb83 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:00.721276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509585a-6429-468e-bb10-4ad7cc8ceb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:00.728704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-0aaf1d93-46b3-46f2-9591-70df0f45a902 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:00.729889 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-0aaf1d93-46b3-46f2-9591-70df0f45a902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:00.762762 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG passlib.handlers.bcrypt [None req-3509585a-6429-468e-bb10-4ad7cc8ceb83 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88357) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 12:03:00.763144 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG passlib.handlers.bcrypt [None req-3509585a-6429-468e-bb10-4ad7cc8ceb83 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88357) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 12:03:00.812863 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-3509585a-6429-468e-bb10-4ad7cc8ceb83 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:00.814493 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-3509585a-6429-468e-bb10-4ad7cc8ceb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:00.815395 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:03:00.916672 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:03:01.136541 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf1d93-46b3-46f2-9591-70df0f45a902 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:01.160945 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:01.240792 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509585a-6429-468e-bb10-4ad7cc8ceb83 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:01.348116 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509585a-6429-468e-bb10-4ad7cc8ceb83 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:01.350802 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:01.358135 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf1d93-46b3-46f2-9591-70df0f45a902 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:01.394890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ebbdd-8ae5-468a-8747-57bccd97b182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:01.395667 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ebbdd-8ae5-468a-8747-57bccd97b182 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:01.395950 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ebbdd-8ae5-468a-8747-57bccd97b182 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:01.396222 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ebbdd-8ae5-468a-8747-57bccd97b182 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:01.397261 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa865a-b5de-483e-a0bb-3335a5938b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:01.398007 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa865a-b5de-483e-a0bb-3335a5938b37 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:01.398294 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa865a-b5de-483e-a0bb-3335a5938b37 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:01.398595 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa865a-b5de-483e-a0bb-3335a5938b37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:01.409710 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa865a-b5de-483e-a0bb-3335a5938b37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:01.419129 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-c3fa865a-b5de-483e-a0bb-3335a5938b37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:01.419129 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:01.419129 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:01.419129 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:01.419129 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:01.419129 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:01.419129 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:01.419129 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:01.419129 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:01.419129 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:01.419129 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:01.419129 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:01.419129 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:01.419129 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:01.419129 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:01.419129 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:01.420059 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:01.420059 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:01.420059 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:01.420059 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:01.420059 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:01.420059 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:01.420059 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:01.420059 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:01.420059 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:01.420059 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:01.420059 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:01.420059 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:01.420059 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:01.420059 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:01.420059 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:01.420059 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:01.420899 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:01.420899 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:01.420899 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:01.420899 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:01.420899 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:01.420899 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:01.420899 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:01.420899 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:01.420899 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:01.420899 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:01.420899 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:01.420899 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:03:01.420899 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Sep 13 12:03:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:01.425954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa865a-b5de-483e-a0bb-3335a5938b37 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:01.470395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ebbdd-8ae5-468a-8747-57bccd97b182 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:01.472297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ebbdd-8ae5-468a-8747-57bccd97b182 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:01.512564 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:01.532916 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa865a-b5de-483e-a0bb-3335a5938b37 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:01.567319 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50485d9e-fbba-474f-9820-e2a79e09e5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:01.567917 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50485d9e-fbba-474f-9820-e2a79e09e5bb None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:01.568198 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50485d9e-fbba-474f-9820-e2a79e09e5bb None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:01.568498 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50485d9e-fbba-474f-9820-e2a79e09e5bb None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:01.570088 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50485d9e-fbba-474f-9820-e2a79e09e5bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:01.570395 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50485d9e-fbba-474f-9820-e2a79e09e5bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:01.571822 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50485d9e-fbba-474f-9820-e2a79e09e5bb None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:01.577889 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 8/15] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 12:03:01.583727 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 8/16] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:01.583869 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ebbdd-8ae5-468a-8747-57bccd97b182 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:01.586552 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:01.589061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50485d9e-fbba-474f-9820-e2a79e09e5bb None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:01.686323 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ebbdd-8ae5-468a-8747-57bccd97b182 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:01.691134 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50485d9e-fbba-474f-9820-e2a79e09e5bb None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:01.720058 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96494565-5f9b-43a2-b35c-86656e0efcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:01.720906 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96494565-5f9b-43a2-b35c-86656e0efcce None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:01.721183 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96494565-5f9b-43a2-b35c-86656e0efcce None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:01.721464 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96494565-5f9b-43a2-b35c-86656e0efcce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:01.725488 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205b8d2-492d-4e49-b9ab-dee131025a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:01.726170 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205b8d2-492d-4e49-b9ab-dee131025a89 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:01.726452 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205b8d2-492d-4e49-b9ab-dee131025a89 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:01.726769 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205b8d2-492d-4e49-b9ab-dee131025a89 None admin] PATH_INFO: `/v3/users/e8c852aa86d546e6891e0dac7b3ec7f8` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:01.728366 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205b8d2-492d-4e49-b9ab-dee131025a89 None admin] RBAC: Authorizing `identity:get_user(user_id=e8c852aa86d546e6891e0dac7b3ec7f8)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:01.729832 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205b8d2-492d-4e49-b9ab-dee131025a89 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:01.731448 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 9/17] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:01 2022] GET /identity/v3/users/e8c852aa86d546e6891e0dac7b3ec7f8 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:01.737293 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205b8d2-492d-4e49-b9ab-dee131025a89 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:01.744049 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96494565-5f9b-43a2-b35c-86656e0efcce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:01.745881 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96494565-5f9b-43a2-b35c-86656e0efcce None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:01.752989 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:01.847830 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205b8d2-492d-4e49-b9ab-dee131025a89 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:01.881594 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-96494565-5f9b-43a2-b35c-86656e0efcce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:01.881594 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:01.881594 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:01.881594 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:01.881594 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:01.881594 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:01.881594 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:01.881594 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:01.881594 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:01.881594 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:01.881594 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:01.881594 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:01.881594 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:01.881594 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:01.881594 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:01.881594 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:01.882570 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:01.882570 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:01.882570 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:01.882570 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:01.882570 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:01.882570 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:01.882570 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:01.882570 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:01.882570 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:01.882570 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:01.882570 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:01.882570 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:01.882570 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:01.882570 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:01.882570 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:01.882570 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:01.882570 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:01.883499 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:01.883499 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:01.883499 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:03:01.883499 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 9/18] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:01.885409 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3c9b8-563b-405c-a192-59a460441642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:01.886035 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3c9b8-563b-405c-a192-59a460441642 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:01.886344 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3c9b8-563b-405c-a192-59a460441642 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:01.886646 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3c9b8-563b-405c-a192-59a460441642 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:01.887794 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3c9b8-563b-405c-a192-59a460441642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:01.888961 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96494565-5f9b-43a2-b35c-86656e0efcce None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:01.889249 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3c9b8-563b-405c-a192-59a460441642 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:01.890817 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 10/19] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:01.896289 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3c9b8-563b-405c-a192-59a460441642 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:01.950261 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:01.983724 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:01.997754 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96494565-5f9b-43a2-b35c-86656e0efcce None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:02.003729 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3c9b8-563b-405c-a192-59a460441642 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:02.032575 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f86049-ccc3-42a4-ae99-40ba65642a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:02.033182 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f86049-ccc3-42a4-ae99-40ba65642a3b None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:02.033460 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f86049-ccc3-42a4-ae99-40ba65642a3b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:02.033737 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f86049-ccc3-42a4-ae99-40ba65642a3b None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:02.034379 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f86049-ccc3-42a4-ae99-40ba65642a3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:02.034712 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f86049-ccc3-42a4-ae99-40ba65642a3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:02.036088 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f86049-ccc3-42a4-ae99-40ba65642a3b None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:02.038089 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63dc4a-d996-4038-9eee-163a0c81eb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:02.038887 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63dc4a-d996-4038-9eee-163a0c81eb72 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:02.039168 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63dc4a-d996-4038-9eee-163a0c81eb72 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:02.039441 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63dc4a-d996-4038-9eee-163a0c81eb72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:02.040188 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63dc4a-d996-4038-9eee-163a0c81eb72 None admin] RBAC: Adding query filter params (role.id=5609ac7373ba400593bba6d811e3aa72, scope.domain.id=default, user.id=e8c852aa86d546e6891e0dac7b3ec7f8) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:02.040496 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63dc4a-d996-4038-9eee-163a0c81eb72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:02.042651 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63dc4a-d996-4038-9eee-163a0c81eb72 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:02.049861 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 11/20] 10.222.0.15 () {56 vars in 1322 bytes} [Tue Sep 13 12:03:01 2022] GET /identity/v3/role_assignments?user.id=e8c852aa86d546e6891e0dac7b3ec7f8&scope.domain.id=default&role.id=5609ac7373ba400593bba6d811e3aa72 => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:02.054793 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 10/21] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:04.840204 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581659a-5535-4fd1-b5d8-4cce8255415b None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:04.841118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581659a-5535-4fd1-b5d8-4cce8255415b None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:04.841542 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581659a-5535-4fd1-b5d8-4cce8255415b None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:04.843170 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 12/22] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:04.860150 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc96c84-e26d-4885-b13b-548dc1d8dfd6 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:04.861034 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc96c84-e26d-4885-b13b-548dc1d8dfd6 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:04.861469 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc96c84-e26d-4885-b13b-548dc1d8dfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:04.889221 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-dcc96c84-e26d-4885-b13b-548dc1d8dfd6 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:04.890726 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-dcc96c84-e26d-4885-b13b-548dc1d8dfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:04.977249 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 11/23] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:05.049428 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d16935-2e1f-4844-9474-6c2317c1784c None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:05.050052 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d16935-2e1f-4844-9474-6c2317c1784c None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:05.050561 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d16935-2e1f-4844-9474-6c2317c1784c None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:05.052151 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:05.058445 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c01a96-1624-4711-abf2-b87c9852fbb2 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:05.058827 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c01a96-1624-4711-abf2-b87c9852fbb2 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:05.059147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c01a96-1624-4711-abf2-b87c9852fbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:05.091739 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-b4c01a96-1624-4711-abf2-b87c9852fbb2 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:05.093283 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-b4c01a96-1624-4711-abf2-b87c9852fbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:05.144418 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:05.180384 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 12/25] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:05.485108 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d16935-2e1f-4844-9474-6c2317c1784c None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:05.671562 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d16935-2e1f-4844-9474-6c2317c1784c None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:05.686203 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c01a96-1624-4711-abf2-b87c9852fbb2 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:05.730973 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c2d66-e6bc-4067-ab89-440b8ba8a4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:05.732119 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c2d66-e6bc-4067-ab89-440b8ba8a4bb None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:05.733740 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c2d66-e6bc-4067-ab89-440b8ba8a4bb None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:05.734841 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c2d66-e6bc-4067-ab89-440b8ba8a4bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:05.757373 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c2d66-e6bc-4067-ab89-440b8ba8a4bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:05.763374 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-995c2d66-e6bc-4067-ab89-440b8ba8a4bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:05.763374 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:05.763374 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:05.763374 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:05.763374 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:05.763374 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:05.763374 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:05.763374 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:05.763374 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:05.763374 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:05.763374 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:05.763374 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:05.763374 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:05.763374 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:05.763374 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:05.763374 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:05.764321 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:05.764321 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:05.764321 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:05.764321 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:05.764321 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:05.764321 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:05.764321 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:05.764321 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:05.764321 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:05.764321 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:05.764321 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:05.764321 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:05.764321 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:05.764321 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:05.764321 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:05.764321 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:05.765076 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:05.765076 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:05.765076 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:05.765076 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:05.765076 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:05.765076 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:05.765076 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:05.765076 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:05.765076 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:05.765076 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:05.765076 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:05.765076 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:03:05.776270 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 14/26] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Sep 13 12:03:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:05.777807 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eaea94-1d11-4278-8b2c-72d81acb1b96 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:05.778499 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eaea94-1d11-4278-8b2c-72d81acb1b96 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:05.779753 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eaea94-1d11-4278-8b2c-72d81acb1b96 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:05.781395 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 15/27] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:05.783893 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eaea94-1d11-4278-8b2c-72d81acb1b96 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:05.793232 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:05.892019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c01a96-1624-4711-abf2-b87c9852fbb2 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:05.940885 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eaea94-1d11-4278-8b2c-72d81acb1b96 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:05.962174 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334bf9a-664f-47ea-86ff-7ab1d9b25616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:05.963214 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334bf9a-664f-47ea-86ff-7ab1d9b25616 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:05.963706 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334bf9a-664f-47ea-86ff-7ab1d9b25616 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:05.964173 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334bf9a-664f-47ea-86ff-7ab1d9b25616 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:05.977296 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334bf9a-664f-47ea-86ff-7ab1d9b25616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:05.979196 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334bf9a-664f-47ea-86ff-7ab1d9b25616 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:05.998934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-b334bf9a-664f-47ea-86ff-7ab1d9b25616 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:05.998934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:05.998934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:05.998934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:05.998934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:05.998934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:05.998934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:05.998934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:05.998934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:05.998934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:05.998934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:05.998934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:05.998934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:03:05.998934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:03:05.998934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:03:05.998934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:03:05.999831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:05.999831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:05.999831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:05.999831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:05.999831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:05.999831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:05.999831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:05.999831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:05.999831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:05.999831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:05.999831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:05.999831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:05.999831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:05.999831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:05.999831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:05.999831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:05.999831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:03:06.000640 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:03:06.000640 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:03:06.000640 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:03:06.003234 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 13/28] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:06.004871 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db57ec-a019-40e4-9025-80e2c9027c39 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:06.010597 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db57ec-a019-40e4-9025-80e2c9027c39 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:06.010745 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41159916-102d-4307-b5e0-b830e46d21c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:06.010745 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41159916-102d-4307-b5e0-b830e46d21c7 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:06.010745 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41159916-102d-4307-b5e0-b830e46d21c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:06.010745 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41159916-102d-4307-b5e0-b830e46d21c7 None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:06.011014 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41159916-102d-4307-b5e0-b830e46d21c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:06.011014 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41159916-102d-4307-b5e0-b830e46d21c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:06.012018 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db57ec-a019-40e4-9025-80e2c9027c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:06.012506 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41159916-102d-4307-b5e0-b830e46d21c7 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:06.039125 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-b2db57ec-a019-40e4-9025-80e2c9027c39 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:06.040856 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-b2db57ec-a019-40e4-9025-80e2c9027c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:06.044015 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 16/29] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:06.048492 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41159916-102d-4307-b5e0-b830e46d21c7 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:06.091830 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:06.152495 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 14/30] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:06.153973 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db57ec-a019-40e4-9025-80e2c9027c39 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:06.168735 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:06.236440 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41159916-102d-4307-b5e0-b830e46d21c7 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:06.286268 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa8f25-5c4f-4bad-b140-58d5f511a050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:06.287687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa8f25-5c4f-4bad-b140-58d5f511a050 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:06.288180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa8f25-5c4f-4bad-b140-58d5f511a050 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:06.288791 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa8f25-5c4f-4bad-b140-58d5f511a050 None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:06.289700 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa8f25-5c4f-4bad-b140-58d5f511a050 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:06.290154 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa8f25-5c4f-4bad-b140-58d5f511a050 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:06.292068 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa8f25-5c4f-4bad-b140-58d5f511a050 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:06.313580 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 17/31] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:06.315257 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd83b33-a290-4850-947c-98a705a4d2d6 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:06.315778 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd83b33-a290-4850-947c-98a705a4d2d6 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:06.316217 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd83b33-a290-4850-947c-98a705a4d2d6 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:06.317640 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 18/32] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:06.321092 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd83b33-a290-4850-947c-98a705a4d2d6 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:06.328282 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db57ec-a019-40e4-9025-80e2c9027c39 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:06.374140 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48395c11-b6d8-4768-9dd8-85e0f76c308d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:06.375057 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48395c11-b6d8-4768-9dd8-85e0f76c308d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:06.375600 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48395c11-b6d8-4768-9dd8-85e0f76c308d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:06.376085 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48395c11-b6d8-4768-9dd8-85e0f76c308d None admin] PATH_INFO: `/v3/users/e8c852aa86d546e6891e0dac7b3ec7f8` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:06.382176 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48395c11-b6d8-4768-9dd8-85e0f76c308d None admin] RBAC: Authorizing `identity:get_user(user_id=e8c852aa86d546e6891e0dac7b3ec7f8)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:06.384989 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48395c11-b6d8-4768-9dd8-85e0f76c308d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:06.391196 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 15/33] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:06 2022] GET /identity/v3/users/e8c852aa86d546e6891e0dac7b3ec7f8 => generated 247 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:06.396404 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3f1da-d880-40be-8280-e07808e45854 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:06.397112 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3f1da-d880-40be-8280-e07808e45854 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:06.398334 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3f1da-d880-40be-8280-e07808e45854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:06.444517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-2ec3f1da-d880-40be-8280-e07808e45854 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:06.447943 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-2ec3f1da-d880-40be-8280-e07808e45854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:06.494481 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:06.542062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd83b33-a290-4850-947c-98a705a4d2d6 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:06.573677 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:06.587990 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5b586-de45-479f-a713-afb20c7ae696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:06.588974 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5b586-de45-479f-a713-afb20c7ae696 None admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:06.589422 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5b586-de45-479f-a713-afb20c7ae696 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:06.589839 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5b586-de45-479f-a713-afb20c7ae696 None admin] PATH_INFO: `/v3/projects` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:06.590686 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5b586-de45-479f-a713-afb20c7ae696 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:06.592686 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 16/34] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:06.592991 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5b586-de45-479f-a713-afb20c7ae696 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:06.593750 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3f1da-d880-40be-8280-e07808e45854 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:06.769173 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3f1da-d880-40be-8280-e07808e45854 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:06.806991 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 19/35] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Sep 13 12:03:06 2022] POST /identity/v3/projects => generated 301 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:06.808053 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5b586-de45-479f-a713-afb20c7ae696 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:06.823980 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211036e-1cee-41b7-9e71-edbdb5e9030b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:06.824724 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211036e-1cee-41b7-9e71-edbdb5e9030b None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:06.825031 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211036e-1cee-41b7-9e71-edbdb5e9030b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:06.825351 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211036e-1cee-41b7-9e71-edbdb5e9030b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:06.832008 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211036e-1cee-41b7-9e71-edbdb5e9030b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:06.833881 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d211036e-1cee-41b7-9e71-edbdb5e9030b None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:06.835853 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 17/36] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:06.837196 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471f7e6-6785-4441-bbe9-356117de61f6 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:06.841255 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471f7e6-6785-4441-bbe9-356117de61f6 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:06.841255 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471f7e6-6785-4441-bbe9-356117de61f6 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:06.841559 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 18/37] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:06.847070 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471f7e6-6785-4441-bbe9-356117de61f6 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:06.907613 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:07.010574 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5b586-de45-479f-a713-afb20c7ae696 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:07.048509 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471f7e6-6785-4441-bbe9-356117de61f6 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:07.066660 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b690308-1d55-4c92-a4a4-b331120d981c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:07.067196 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b690308-1d55-4c92-a4a4-b331120d981c None admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:07.067485 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b690308-1d55-4c92-a4a4-b331120d981c None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:07.067767 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b690308-1d55-4c92-a4a4-b331120d981c None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:07.069472 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b690308-1d55-4c92-a4a4-b331120d981c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:07.070093 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b690308-1d55-4c92-a4a4-b331120d981c None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:07.091645 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 20/38] 10.222.0.15 () {60 vars in 1131 bytes} [Tue Sep 13 12:03:06 2022] POST /identity/v3/roles => generated 219 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:07.093095 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e30814-ae68-471d-ab3e-460be27722a4 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:07.093438 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e30814-ae68-471d-ab3e-460be27722a4 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:07.093724 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e30814-ae68-471d-ab3e-460be27722a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:07.094828 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634fe4e-d194-48da-a640-46b9056f0c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:07.095511 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634fe4e-d194-48da-a640-46b9056f0c2c None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:07.095793 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634fe4e-d194-48da-a640-46b9056f0c2c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:07.096103 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634fe4e-d194-48da-a640-46b9056f0c2c None admin] PATH_INFO: `/v3/domains/default/users/e8c852aa86d546e6891e0dac7b3ec7f8/roles/5609ac7373ba400593bba6d811e3aa72` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:07.098125 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634fe4e-d194-48da-a640-46b9056f0c2c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e8c852aa86d546e6891e0dac7b3ec7f8, role_id=5609ac7373ba400593bba6d811e3aa72)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:07.100241 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634fe4e-d194-48da-a640-46b9056f0c2c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:07.120470 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-f3e30814-ae68-471d-ab3e-460be27722a4 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:07.122548 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-f3e30814-ae68-471d-ab3e-460be27722a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:07.163504 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:07.228477 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 21/39] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:07.229677 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e30814-ae68-471d-ab3e-460be27722a4 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:07.241702 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 19/40] 10.222.0.15 () {58 vars in 1361 bytes} [Tue Sep 13 12:03:06 2022] PUT /identity/v3/domains/default/users/e8c852aa86d546e6891e0dac7b3ec7f8/roles/5609ac7373ba400593bba6d811e3aa72 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:03:07.243302 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b52c16-c53b-499b-a5fb-6cbd52f3a3fe None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:07.243601 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b52c16-c53b-499b-a5fb-6cbd52f3a3fe None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:07.243887 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b52c16-c53b-499b-a5fb-6cbd52f3a3fe None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:07.248367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 20/41] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:07.254638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc6d8e-a44a-48ab-bc3e-501f48d6ff1b None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:07.255136 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc6d8e-a44a-48ab-bc3e-501f48d6ff1b None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:07.255460 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc6d8e-a44a-48ab-bc3e-501f48d6ff1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:07.279296 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-e7dc6d8e-a44a-48ab-bc3e-501f48d6ff1b None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:07.280907 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-e7dc6d8e-a44a-48ab-bc3e-501f48d6ff1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:07.389776 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e30814-ae68-471d-ab3e-460be27722a4 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:07.394232 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 21/42] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:03:07.434768 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2471f5e-1a4a-49d5-b870-d1662a86b118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:07.435478 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2471f5e-1a4a-49d5-b870-d1662a86b118 None admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:07.435768 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2471f5e-1a4a-49d5-b870-d1662a86b118 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:07.436039 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2471f5e-1a4a-49d5-b870-d1662a86b118 None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:07.436818 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2471f5e-1a4a-49d5-b870-d1662a86b118 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:07.438457 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2471f5e-1a4a-49d5-b870-d1662a86b118 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:07.457546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 22/43] 10.222.0.15 () {60 vars in 1131 bytes} [Tue Sep 13 12:03:07 2022] POST /identity/v3/roles => generated 225 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:07.658904 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc6d8e-a44a-48ab-bc3e-501f48d6ff1b None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:07.689720 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:07.797913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2471f5e-1a4a-49d5-b870-d1662a86b118 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:07.809612 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc6d8e-a44a-48ab-bc3e-501f48d6ff1b None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:07.839023 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:07.852820 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae7b30-b7df-4be7-973f-472a680f7cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:07.853470 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae7b30-b7df-4be7-973f-472a680f7cb1 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:07.853755 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae7b30-b7df-4be7-973f-472a680f7cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:07.854025 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae7b30-b7df-4be7-973f-472a680f7cb1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:07.855180 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae7b30-b7df-4be7-973f-472a680f7cb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:07.856772 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae7b30-b7df-4be7-973f-472a680f7cb1 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:07.858507 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 22/44] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:07.863993 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae7b30-b7df-4be7-973f-472a680f7cb1 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:07.920577 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2471f5e-1a4a-49d5-b870-d1662a86b118 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:07.962137 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e595c-3db1-4cc6-8ded-b6aeff10fdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:07.962759 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e595c-3db1-4cc6-8ded-b6aeff10fdac None admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:07.963013 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e595c-3db1-4cc6-8ded-b6aeff10fdac None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:07.963310 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e595c-3db1-4cc6-8ded-b6aeff10fdac None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:07.963950 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e595c-3db1-4cc6-8ded-b6aeff10fdac None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:07.965314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e595c-3db1-4cc6-8ded-b6aeff10fdac None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:07.973309 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:07.981612 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 23/45] 10.222.0.15 () {60 vars in 1131 bytes} [Tue Sep 13 12:03:07 2022] POST /identity/v3/roles => generated 223 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:08.001209 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae7b30-b7df-4be7-973f-472a680f7cb1 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:08.043491 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3af9ce-9497-4a4f-8187-cdb987950e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:08.044423 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3af9ce-9497-4a4f-8187-cdb987950e3b None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:08.044849 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3af9ce-9497-4a4f-8187-cdb987950e3b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:08.045269 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3af9ce-9497-4a4f-8187-cdb987950e3b None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:08.046078 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3af9ce-9497-4a4f-8187-cdb987950e3b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:08.047765 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3af9ce-9497-4a4f-8187-cdb987950e3b None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:08.081835 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 23/46] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Sep 13 12:03:07 2022] POST /identity/v3/projects => generated 312 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:09.860932 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f1535-e3e2-4493-bb1a-6564db73c037 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:09.861443 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f1535-e3e2-4493-bb1a-6564db73c037 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:09.861552 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f1535-e3e2-4493-bb1a-6564db73c037 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:09.862860 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 24/47] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:09.868449 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49900f9-063f-4625-a5e2-6bfec572b148 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:09.868861 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49900f9-063f-4625-a5e2-6bfec572b148 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:09.869126 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49900f9-063f-4625-a5e2-6bfec572b148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:09.887064 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-b49900f9-063f-4625-a5e2-6bfec572b148 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:09.888262 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-b49900f9-063f-4625-a5e2-6bfec572b148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:09.960443 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 24/48] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:10.281817 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f1535-e3e2-4493-bb1a-6564db73c037 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:10.378709 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:10.396415 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f1535-e3e2-4493-bb1a-6564db73c037 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:10.430329 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64307fc1-2ae6-47ae-a826-b3415839ea2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:10.430998 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64307fc1-2ae6-47ae-a826-b3415839ea2b None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:10.431285 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64307fc1-2ae6-47ae-a826-b3415839ea2b None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:10.431564 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64307fc1-2ae6-47ae-a826-b3415839ea2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:10.442285 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64307fc1-2ae6-47ae-a826-b3415839ea2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:10.447853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-64307fc1-2ae6-47ae-a826-b3415839ea2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:10.447853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:10.447853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:10.447853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:10.447853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:10.447853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:10.447853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:10.447853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:10.447853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:10.447853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:10.447853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:10.447853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:10.447853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:10.447853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:10.447853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:10.447853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:10.448691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:10.448691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:10.448691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:10.448691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:10.448691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:10.448691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:10.448691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:10.448691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:10.448691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:10.448691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:10.448691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:10.448691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:10.448691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:10.448691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:10.448691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:10.448691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:10.449623 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:10.449623 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:10.449623 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:10.449623 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:10.449623 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:10.449623 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:10.449623 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:10.449623 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:10.449623 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:10.449623 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:10.449623 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:10.449623 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:03:10.449623 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 25/49] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Sep 13 12:03:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:10.454728 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49900f9-063f-4625-a5e2-6bfec572b148 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:10.517521 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:10.560452 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49900f9-063f-4625-a5e2-6bfec572b148 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:10.594410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a9ce9-cf4e-44ef-b6a1-13d1bd9dc20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:10.595059 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a9ce9-cf4e-44ef-b6a1-13d1bd9dc20d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:10.595344 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a9ce9-cf4e-44ef-b6a1-13d1bd9dc20d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:10.595617 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a9ce9-cf4e-44ef-b6a1-13d1bd9dc20d None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:10.596319 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a9ce9-cf4e-44ef-b6a1-13d1bd9dc20d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:10.596624 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a9ce9-cf4e-44ef-b6a1-13d1bd9dc20d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:10.597999 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a9ce9-cf4e-44ef-b6a1-13d1bd9dc20d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:10.610201 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 25/50] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:10.616042 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64307fc1-2ae6-47ae-a826-b3415839ea2b None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:10.724199 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64307fc1-2ae6-47ae-a826-b3415839ea2b None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:10.758207 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043bd00-7ea3-4ef5-84f7-7b58e34edfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:10.758861 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043bd00-7ea3-4ef5-84f7-7b58e34edfdb None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:10.759148 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043bd00-7ea3-4ef5-84f7-7b58e34edfdb None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:10.759427 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043bd00-7ea3-4ef5-84f7-7b58e34edfdb None admin] PATH_INFO: `/v3/users/e8c852aa86d546e6891e0dac7b3ec7f8` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:10.760577 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043bd00-7ea3-4ef5-84f7-7b58e34edfdb None admin] RBAC: Authorizing `identity:get_user(user_id=e8c852aa86d546e6891e0dac7b3ec7f8)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:10.762057 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043bd00-7ea3-4ef5-84f7-7b58e34edfdb None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:10.762699 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b7374-3193-4f35-83bb-5cb9c1db951f None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:10.763067 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b7374-3193-4f35-83bb-5cb9c1db951f None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:10.763424 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b7374-3193-4f35-83bb-5cb9c1db951f None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:10.767973 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 26/51] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:10 2022] GET /identity/v3/users/e8c852aa86d546e6891e0dac7b3ec7f8 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:10.768129 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 26/52] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:03:10.768950 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043bd00-7ea3-4ef5-84f7-7b58e34edfdb None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:10.771879 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f824d-3009-47bf-a071-420a38e8dd99 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:10.772161 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f824d-3009-47bf-a071-420a38e8dd99 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:10.772442 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f824d-3009-47bf-a071-420a38e8dd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:10.789569 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:10.794603 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-133f824d-3009-47bf-a071-420a38e8dd99 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:10.795862 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-133f824d-3009-47bf-a071-420a38e8dd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:10.865387 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 27/53] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:03:10.874812 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043bd00-7ea3-4ef5-84f7-7b58e34edfdb None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:10.910598 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905f03d-0ce6-4cc4-b963-93503dae1727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:10.911257 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905f03d-0ce6-4cc4-b963-93503dae1727 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:10.911680 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905f03d-0ce6-4cc4-b963-93503dae1727 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:10.912074 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905f03d-0ce6-4cc4-b963-93503dae1727 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:10.913215 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905f03d-0ce6-4cc4-b963-93503dae1727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:10.914697 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905f03d-0ce6-4cc4-b963-93503dae1727 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:10.916513 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 27/54] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:10.922300 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f824d-3009-47bf-a071-420a38e8dd99 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:10.987704 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:11.034155 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f824d-3009-47bf-a071-420a38e8dd99 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:11.067468 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc1d02-c0ca-4456-9a3f-b2dfa9c3e366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:11.068820 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc1d02-c0ca-4456-9a3f-b2dfa9c3e366 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:11.069169 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc1d02-c0ca-4456-9a3f-b2dfa9c3e366 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:11.069535 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc1d02-c0ca-4456-9a3f-b2dfa9c3e366 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:11.070332 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc1d02-c0ca-4456-9a3f-b2dfa9c3e366 None admin] RBAC: Adding query filter params (role.id=5609ac7373ba400593bba6d811e3aa72, scope.domain.id=default, user.id=e8c852aa86d546e6891e0dac7b3ec7f8) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:11.070743 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc1d02-c0ca-4456-9a3f-b2dfa9c3e366 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:11.072258 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc1d02-c0ca-4456-9a3f-b2dfa9c3e366 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:11.080302 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 28/55] 10.222.0.15 () {56 vars in 1322 bytes} [Tue Sep 13 12:03:10 2022] GET /identity/v3/role_assignments?user.id=e8c852aa86d546e6891e0dac7b3ec7f8&scope.domain.id=default&role.id=5609ac7373ba400593bba6d811e3aa72 => generated 530 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:11.189868 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905f03d-0ce6-4cc4-b963-93503dae1727 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:11.284977 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:11.308392 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905f03d-0ce6-4cc4-b963-93503dae1727 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:11.345468 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0d3a2-69ef-4fc2-83eb-fe5af76a7ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:11.346099 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0d3a2-69ef-4fc2-83eb-fe5af76a7ff8 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:11.346383 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0d3a2-69ef-4fc2-83eb-fe5af76a7ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:11.346689 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0d3a2-69ef-4fc2-83eb-fe5af76a7ff8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:11.347804 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0d3a2-69ef-4fc2-83eb-fe5af76a7ff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:11.349280 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0d3a2-69ef-4fc2-83eb-fe5af76a7ff8 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:11.351148 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 28/56] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:11.357225 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc1d02-c0ca-4456-9a3f-b2dfa9c3e366 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:11.461114 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc1d02-c0ca-4456-9a3f-b2dfa9c3e366 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:11.481939 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:11.498878 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d763608-204c-4a97-82a0-48a6c79c1293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:11.499492 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d763608-204c-4a97-82a0-48a6c79c1293 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:11.499772 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d763608-204c-4a97-82a0-48a6c79c1293 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:11.500042 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d763608-204c-4a97-82a0-48a6c79c1293 None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:11.500687 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d763608-204c-4a97-82a0-48a6c79c1293 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:11.502401 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d763608-204c-4a97-82a0-48a6c79c1293 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:11.532665 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 29/57] 10.222.0.15 () {60 vars in 1140 bytes} [Tue Sep 13 12:03:11 2022] POST /identity/v3/projects => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:13.945609 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3cb29-e590-40bd-b03e-95a4cf69be20 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:13.946092 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3cb29-e590-40bd-b03e-95a4cf69be20 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:13.946092 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3cb29-e590-40bd-b03e-95a4cf69be20 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:13.947439 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 29/58] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:13.952778 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416875b-9848-40ac-9bbb-860aa68225a9 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:13.953174 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416875b-9848-40ac-9bbb-860aa68225a9 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:13.953333 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416875b-9848-40ac-9bbb-860aa68225a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:13.971301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-4416875b-9848-40ac-9bbb-860aa68225a9 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:13.972492 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-4416875b-9848-40ac-9bbb-860aa68225a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:14.039880 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 30/59] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:14.363569 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3cb29-e590-40bd-b03e-95a4cf69be20 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:14.472540 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3cb29-e590-40bd-b03e-95a4cf69be20 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:14.510883 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7e071-d949-4436-8d1e-3af43a6a9b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:14.511496 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7e071-d949-4436-8d1e-3af43a6a9b0e None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:14.511775 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7e071-d949-4436-8d1e-3af43a6a9b0e None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:14.512047 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7e071-d949-4436-8d1e-3af43a6a9b0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:14.513470 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7e071-d949-4436-8d1e-3af43a6a9b0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:14.514944 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a7e071-d949-4436-8d1e-3af43a6a9b0e None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:14.516485 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 30/60] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:14.522607 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416875b-9848-40ac-9bbb-860aa68225a9 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:14.619740 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416875b-9848-40ac-9bbb-860aa68225a9 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:14.621202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:14.655903 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ec689-5f45-40e3-bbab-c41a11823108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:14.656509 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ec689-5f45-40e3-bbab-c41a11823108 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:14.656792 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ec689-5f45-40e3-bbab-c41a11823108 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:14.657067 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ec689-5f45-40e3-bbab-c41a11823108 None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:14.657707 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ec689-5f45-40e3-bbab-c41a11823108 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:14.659181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ec689-5f45-40e3-bbab-c41a11823108 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:14.685835 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 31/61] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Sep 13 12:03:14 2022] POST /identity/v3/users => generated 275 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:18.080274 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b3e9e-0242-43a7-a1ec-9ffb8eba371c None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:18.081292 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b3e9e-0242-43a7-a1ec-9ffb8eba371c None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:18.081769 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b3e9e-0242-43a7-a1ec-9ffb8eba371c None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:18.084275 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 31/62] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:18.090253 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf083ce0-da39-436c-a365-89a22e172a7b None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:18.091100 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf083ce0-da39-436c-a365-89a22e172a7b None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:18.091568 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf083ce0-da39-436c-a365-89a22e172a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:18.118866 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-cf083ce0-da39-436c-a365-89a22e172a7b None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:18.120476 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-cf083ce0-da39-436c-a365-89a22e172a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:18.212956 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 32/63] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:18.793154 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b3e9e-0242-43a7-a1ec-9ffb8eba371c None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:18.821534 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:18.854642 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fddb1b-8f38-48e4-ae17-40cc25765ba8 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:18.854989 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fddb1b-8f38-48e4-ae17-40cc25765ba8 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:18.855196 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fddb1b-8f38-48e4-ae17-40cc25765ba8 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:18.856530 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 33/64] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:18.861579 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b985d7-4344-4573-aa01-730a7ad1b55e None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:18.861864 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b985d7-4344-4573-aa01-730a7ad1b55e None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:18.862138 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b985d7-4344-4573-aa01-730a7ad1b55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:18.898569 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-72b985d7-4344-4573-aa01-730a7ad1b55e None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:18.899908 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-72b985d7-4344-4573-aa01-730a7ad1b55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:18.945454 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b3e9e-0242-43a7-a1ec-9ffb8eba371c None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:18.971753 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 34/65] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:18.973013 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aa676-a587-4766-bf8a-7467a9fee4b2 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:18.973959 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aa676-a587-4766-bf8a-7467a9fee4b2 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:18.974348 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aa676-a587-4766-bf8a-7467a9fee4b2 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:18.982466 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11859153-9e46-405d-9c01-9d42589dd37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:18.983141 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11859153-9e46-405d-9c01-9d42589dd37a None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:18.983419 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11859153-9e46-405d-9c01-9d42589dd37a None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:18.983696 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11859153-9e46-405d-9c01-9d42589dd37a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:18.983863 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 35/66] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:18 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:18.990225 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2848a-5f19-4281-bb8d-5eda45286ef7 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:18.990713 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2848a-5f19-4281-bb8d-5eda45286ef7 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:18.991001 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2848a-5f19-4281-bb8d-5eda45286ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:18.997872 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11859153-9e46-405d-9c01-9d42589dd37a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:19.003535 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-11859153-9e46-405d-9c01-9d42589dd37a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:03:19.003535 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:19.003535 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:19.003535 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:19.003535 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:19.003535 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:19.003535 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:19.003535 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:19.003535 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:19.003535 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:19.003535 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:19.003535 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:19.003535 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:19.003535 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:19.003535 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:19.003535 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:19.004385 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:19.004385 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:19.004385 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:19.004385 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:19.004385 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:19.004385 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:19.004385 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:19.004385 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:19.004385 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:19.004385 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:19.004385 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:19.004385 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:19.004385 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:19.004385 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:19.004385 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:19.004385 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:19.005184 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:19.005184 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:19.005184 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:19.005184 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:19.005184 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:19.005184 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:19.005184 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:19.005184 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:19.005184 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:19.005184 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:19.005184 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:03:19.005184 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:03:19.005184 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 32/67] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:19.018996 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11859153-9e46-405d-9c01-9d42589dd37a None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:19.024097 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-0ed2848a-5f19-4281-bb8d-5eda45286ef7 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:19.025307 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-0ed2848a-5f19-4281-bb8d-5eda45286ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:19.041856 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:19.107981 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 36/68] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:19.110083 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ee0a5-0ca0-42db-ab58-a5ee5435b99e None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:19.110964 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ee0a5-0ca0-42db-ab58-a5ee5435b99e None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:19.111822 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ee0a5-0ca0-42db-ab58-a5ee5435b99e None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:19.113561 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 37/69] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:19.115450 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394eb1db-02d6-4880-95ea-106b79e856d9 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:19.115940 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394eb1db-02d6-4880-95ea-106b79e856d9 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:19.116410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394eb1db-02d6-4880-95ea-106b79e856d9 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:19.118185 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 38/70] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:19.120035 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc9d42-295f-4e16-b569-1c901684e387 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:19.120779 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc9d42-295f-4e16-b569-1c901684e387 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:19.121251 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc9d42-295f-4e16-b569-1c901684e387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:19.140571 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-cfdc9d42-295f-4e16-b569-1c901684e387 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:19.142181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-cfdc9d42-295f-4e16-b569-1c901684e387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:19.143009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:19.155569 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11859153-9e46-405d-9c01-9d42589dd37a None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:19.201955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf557b-2555-4e51-a086-63091cf6c8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:19.203360 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf557b-2555-4e51-a086-63091cf6c8ee None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:19.203869 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf557b-2555-4e51-a086-63091cf6c8ee None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:19.204364 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf557b-2555-4e51-a086-63091cf6c8ee None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:19.205753 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf557b-2555-4e51-a086-63091cf6c8ee None admin] RBAC: Adding query filter params (name=member) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:19.206260 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf557b-2555-4e51-a086-63091cf6c8ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:19.208232 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf557b-2555-4e51-a086-63091cf6c8ee None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:19.225298 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 39/72] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:19.225298 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01922c5e-72ce-489e-ad03-9f8e0c006b5a None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:19.225298 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01922c5e-72ce-489e-ad03-9f8e0c006b5a None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:19.225298 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01922c5e-72ce-489e-ad03-9f8e0c006b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:19.226023 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 33/72] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:03:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:19.227127 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf557b-2555-4e51-a086-63091cf6c8ee None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:19.244248 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-01922c5e-72ce-489e-ad03-9f8e0c006b5a None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:19.245719 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-01922c5e-72ce-489e-ad03-9f8e0c006b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:19.341668 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf557b-2555-4e51-a086-63091cf6c8ee None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:19.345359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 40/73] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:19.380360 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506ad3f-43ea-4a78-a467-c1e997a56643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:19.381304 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506ad3f-43ea-4a78-a467-c1e997a56643 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:19.381649 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506ad3f-43ea-4a78-a467-c1e997a56643 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:19.381990 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506ad3f-43ea-4a78-a467-c1e997a56643 None admin] PATH_INFO: `/v3/users/202e3f4635df4dfca22906fc29c21b69` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:19.395603 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:19.398763 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506ad3f-43ea-4a78-a467-c1e997a56643 None admin] RBAC: Authorizing `identity:get_user(user_id=202e3f4635df4dfca22906fc29c21b69)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:19.400710 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506ad3f-43ea-4a78-a467-c1e997a56643 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:19.403861 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 34/74] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:19 2022] GET /identity/v3/users/202e3f4635df4dfca22906fc29c21b69 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:19.409244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01922c5e-72ce-489e-ad03-9f8e0c006b5a None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:19.429667 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:19.457089 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506ad3f-43ea-4a78-a467-c1e997a56643 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:19.543298 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01922c5e-72ce-489e-ad03-9f8e0c006b5a None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:19.579800 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c5e64-0844-498c-85f8-de22fd750173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:19.580766 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c5e64-0844-498c-85f8-de22fd750173 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:19.581249 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c5e64-0844-498c-85f8-de22fd750173 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:19.581718 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c5e64-0844-498c-85f8-de22fd750173 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:19.588995 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506ad3f-43ea-4a78-a467-c1e997a56643 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:19.641075 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a7fb5-8c6f-4f2a-b53e-42b76f4487ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:19.645728 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a7fb5-8c6f-4f2a-b53e-42b76f4487ed None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:19.646037 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a7fb5-8c6f-4f2a-b53e-42b76f4487ed None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:19.646317 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a7fb5-8c6f-4f2a-b53e-42b76f4487ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:19.654900 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c5e64-0844-498c-85f8-de22fd750173 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:19.656358 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c5e64-0844-498c-85f8-de22fd750173 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:19.662227 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a7fb5-8c6f-4f2a-b53e-42b76f4487ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:19.669125 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:19.674095 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-f74a7fb5-8c6f-4f2a-b53e-42b76f4487ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:19.674095 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:19.674095 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:19.674095 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:19.674095 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:19.674095 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:19.674095 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:19.674095 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:19.674095 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:19.674095 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:19.674095 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:19.674095 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:19.674095 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:19.674095 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:19.674095 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:19.674095 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:19.675114 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:19.675114 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:19.675114 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:19.675114 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:19.675114 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:19.675114 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:19.675114 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:19.675114 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:19.675114 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:19.675114 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:19.675114 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:19.675114 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:19.675114 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:19.675114 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:19.675114 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:19.675114 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:19.675994 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:19.675994 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:19.675994 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:19.675994 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:19.675994 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:19.675994 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:19.675994 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:19.675994 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:19.675994 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:19.675994 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:19.675994 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:19.675994 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:03:19.679550 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 35/75] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Sep 13 12:03:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:19.680940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a7fb5-8c6f-4f2a-b53e-42b76f4487ed None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:19.748461 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:19.768845 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 41/76] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:03:19.769889 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c5e64-0844-498c-85f8-de22fd750173 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:19.794168 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a7fb5-8c6f-4f2a-b53e-42b76f4487ed None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:19.829545 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6304b85-2ae1-4ffd-9470-23baa81277f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:19.830163 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6304b85-2ae1-4ffd-9470-23baa81277f7 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:19.830441 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6304b85-2ae1-4ffd-9470-23baa81277f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:19.830742 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6304b85-2ae1-4ffd-9470-23baa81277f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:19.841386 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6304b85-2ae1-4ffd-9470-23baa81277f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:19.846197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-d6304b85-2ae1-4ffd-9470-23baa81277f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:03:19.846197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:19.846197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:19.846197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:19.846197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:19.846197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:19.846197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:19.846197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:19.846197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:19.846197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:19.846197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:19.846197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:19.846197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:19.846197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:19.846197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:19.846197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:19.847350 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:19.847350 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:19.847350 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:19.847350 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:19.847350 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:19.847350 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:19.847350 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:19.847350 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:19.847350 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:19.847350 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:19.847350 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:19.847350 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:19.847350 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:19.847350 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:19.847350 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:19.847350 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:19.848672 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:19.848672 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:19.848672 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:19.848672 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:19.848672 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:19.848672 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:19.848672 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:19.848672 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:19.848672 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:19.848672 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:19.848672 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:03:19.848672 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:03:19.848672 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 36/77] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Sep 13 12:03:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:19.848672 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6304b85-2ae1-4ffd-9470-23baa81277f7 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:19.873401 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c5e64-0844-498c-85f8-de22fd750173 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:19.882883 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:19.908265 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130c60c-aff7-46f6-9e63-410d5ca7cf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:19.908878 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130c60c-aff7-46f6-9e63-410d5ca7cf7c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:19.909166 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130c60c-aff7-46f6-9e63-410d5ca7cf7c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:19.909443 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130c60c-aff7-46f6-9e63-410d5ca7cf7c None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:19.910104 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130c60c-aff7-46f6-9e63-410d5ca7cf7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:19.910411 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130c60c-aff7-46f6-9e63-410d5ca7cf7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:19.912649 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130c60c-aff7-46f6-9e63-410d5ca7cf7c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:19.921102 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 42/78] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:19.921901 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130c60c-aff7-46f6-9e63-410d5ca7cf7c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:19.951897 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6304b85-2ae1-4ffd-9470-23baa81277f7 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:19.971812 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:19.986946 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa94dd-2837-4dee-a3ce-856c3025ae6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:19.987577 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa94dd-2837-4dee-a3ce-856c3025ae6b None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:19.987861 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa94dd-2837-4dee-a3ce-856c3025ae6b None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:19.988168 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa94dd-2837-4dee-a3ce-856c3025ae6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:19.999154 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa94dd-2837-4dee-a3ce-856c3025ae6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:20.003987 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-49fa94dd-2837-4dee-a3ce-856c3025ae6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:03:20.003987 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:20.003987 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:20.003987 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:20.003987 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:20.003987 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:20.003987 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:20.003987 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:20.003987 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:20.003987 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:20.003987 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:20.003987 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:20.003987 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:20.003987 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:20.003987 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:20.003987 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:20.005031 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:20.005031 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:20.005031 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:20.005031 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:20.005031 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:20.005031 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:20.005031 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:20.005031 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:20.005031 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:20.005031 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:20.005031 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:20.005031 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:20.005031 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:20.005031 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:20.005031 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:20.005031 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:20.005961 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:20.005961 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:20.005961 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:20.005961 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:20.005961 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:20.005961 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:20.005961 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:20.005961 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:20.005961 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:20.005961 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:20.005961 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:03:20.005961 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:03:20.005961 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 37/79] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:20.005961 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa94dd-2837-4dee-a3ce-856c3025ae6b None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:20.027693 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130c60c-aff7-46f6-9e63-410d5ca7cf7c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:20.061414 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f165b6-d6ef-4b7e-8e79-95bedaa199e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:20.062044 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f165b6-d6ef-4b7e-8e79-95bedaa199e3 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:20.062326 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f165b6-d6ef-4b7e-8e79-95bedaa199e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:20.062598 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f165b6-d6ef-4b7e-8e79-95bedaa199e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:20.064040 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f165b6-d6ef-4b7e-8e79-95bedaa199e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:20.065488 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f165b6-d6ef-4b7e-8e79-95bedaa199e3 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:20.067301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 43/80] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:20.068090 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f165b6-d6ef-4b7e-8e79-95bedaa199e3 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:20.108169 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa94dd-2837-4dee-a3ce-856c3025ae6b None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:20.111633 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:20.141706 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab23eb-36a0-48ea-aded-2f2cffd74244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:20.142323 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab23eb-36a0-48ea-aded-2f2cffd74244 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:20.142627 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab23eb-36a0-48ea-aded-2f2cffd74244 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:20.142913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab23eb-36a0-48ea-aded-2f2cffd74244 None admin] PATH_INFO: `/v3/projects/b8c35869b0184f978d0e9bb42b22ad27` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:20.144047 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab23eb-36a0-48ea-aded-2f2cffd74244 None admin] RBAC: Authorizing `identity:get_project(project_id=b8c35869b0184f978d0e9bb42b22ad27)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:20.146020 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab23eb-36a0-48ea-aded-2f2cffd74244 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:20.147675 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 38/81] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:20 2022] GET /identity/v3/projects/b8c35869b0184f978d0e9bb42b22ad27 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:20.147675 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab23eb-36a0-48ea-aded-2f2cffd74244 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:20.174002 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f165b6-d6ef-4b7e-8e79-95bedaa199e3 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:20.202924 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:20.209192 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d908de7-5629-4600-bc87-b66dbccea1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:20.209807 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d908de7-5629-4600-bc87-b66dbccea1ea None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:20.210090 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d908de7-5629-4600-bc87-b66dbccea1ea None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:20.210387 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d908de7-5629-4600-bc87-b66dbccea1ea None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:20.211087 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d908de7-5629-4600-bc87-b66dbccea1ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:20.211390 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d908de7-5629-4600-bc87-b66dbccea1ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:20.212762 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d908de7-5629-4600-bc87-b66dbccea1ea None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:20.220721 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 44/82] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:20.221517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d908de7-5629-4600-bc87-b66dbccea1ea None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:20.256132 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab23eb-36a0-48ea-aded-2f2cffd74244 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:20.292533 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dafab3-460b-4757-b864-94c9aff2897e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:20.293158 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dafab3-460b-4757-b864-94c9aff2897e None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:20.293442 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dafab3-460b-4757-b864-94c9aff2897e None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:20.293723 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dafab3-460b-4757-b864-94c9aff2897e None admin] PATH_INFO: `/v3/users/e8c852aa86d546e6891e0dac7b3ec7f8` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:20.294924 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dafab3-460b-4757-b864-94c9aff2897e None admin] RBAC: Authorizing `identity:get_user(user_id=e8c852aa86d546e6891e0dac7b3ec7f8)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:20.296374 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dafab3-460b-4757-b864-94c9aff2897e None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:20.297937 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 39/83] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:20 2022] GET /identity/v3/users/e8c852aa86d546e6891e0dac7b3ec7f8 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:20.298703 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dafab3-460b-4757-b864-94c9aff2897e None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:20.322916 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:20.326081 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d908de7-5629-4600-bc87-b66dbccea1ea None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:20.362077 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939263c-892d-41bf-a91a-6f410b9928da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:20.362811 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939263c-892d-41bf-a91a-6f410b9928da None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:20.363100 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939263c-892d-41bf-a91a-6f410b9928da None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:20.363382 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939263c-892d-41bf-a91a-6f410b9928da None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:20.364223 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939263c-892d-41bf-a91a-6f410b9928da None admin] RBAC: Adding query filter params (name=member) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:20.364539 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939263c-892d-41bf-a91a-6f410b9928da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:20.365910 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939263c-892d-41bf-a91a-6f410b9928da None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:20.374216 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 45/84] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:03:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:20.375037 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939263c-892d-41bf-a91a-6f410b9928da None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:20.404234 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dafab3-460b-4757-b864-94c9aff2897e None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:20.422814 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:20.444413 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a255a1-1c09-4c3d-9c6c-7e15cba90bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:20.445016 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a255a1-1c09-4c3d-9c6c-7e15cba90bfc None admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:20.445369 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a255a1-1c09-4c3d-9c6c-7e15cba90bfc None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:20.445720 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a255a1-1c09-4c3d-9c6c-7e15cba90bfc None admin] PATH_INFO: `/v3/users` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:20.446487 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a255a1-1c09-4c3d-9c6c-7e15cba90bfc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:20.448114 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a255a1-1c09-4c3d-9c6c-7e15cba90bfc None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:20.476887 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 40/85] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Sep 13 12:03:20 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:20.477714 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a255a1-1c09-4c3d-9c6c-7e15cba90bfc None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:20.497771 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939263c-892d-41bf-a91a-6f410b9928da None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:20.538717 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5d71d-c665-4d1e-9103-f8eb8a823588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:20.539273 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5d71d-c665-4d1e-9103-f8eb8a823588 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:20.539563 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5d71d-c665-4d1e-9103-f8eb8a823588 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:20.539872 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5d71d-c665-4d1e-9103-f8eb8a823588 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:20.540635 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5d71d-c665-4d1e-9103-f8eb8a823588 None admin] RBAC: Adding query filter params (role.id=ab14a68bf5b54561badd35b83e6acaf5, scope.project.id=b8c35869b0184f978d0e9bb42b22ad27, user.id=202e3f4635df4dfca22906fc29c21b69) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:20.541204 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5d71d-c665-4d1e-9103-f8eb8a823588 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:20.543550 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5d71d-c665-4d1e-9103-f8eb8a823588 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:20.563037 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 46/86] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:20 2022] GET /identity/v3/role_assignments?user.id=202e3f4635df4dfca22906fc29c21b69&scope.project.id=b8c35869b0184f978d0e9bb42b22ad27&role.id=ab14a68bf5b54561badd35b83e6acaf5 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:20.563037 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5d71d-c665-4d1e-9103-f8eb8a823588 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:20.596616 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:20.605351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a255a1-1c09-4c3d-9c6c-7e15cba90bfc None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:20.650850 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72683cf-a46b-4128-a8f6-8fa02734cb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:20.651541 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72683cf-a46b-4128-a8f6-8fa02734cb6a None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:20.651800 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72683cf-a46b-4128-a8f6-8fa02734cb6a None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:20.652076 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72683cf-a46b-4128-a8f6-8fa02734cb6a None admin] PATH_INFO: `/v3/users/202e3f4635df4dfca22906fc29c21b69` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:20.653358 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72683cf-a46b-4128-a8f6-8fa02734cb6a None admin] RBAC: Authorizing `identity:get_user(user_id=202e3f4635df4dfca22906fc29c21b69)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:20.655029 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72683cf-a46b-4128-a8f6-8fa02734cb6a None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:20.657159 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 41/87] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:20 2022] GET /identity/v3/users/202e3f4635df4dfca22906fc29c21b69 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:20.657962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72683cf-a46b-4128-a8f6-8fa02734cb6a None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:20.707712 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5d71d-c665-4d1e-9103-f8eb8a823588 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:20.712308 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:20.757552 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358e02d-c931-4ef7-a9ff-2a472c96a01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:20.758231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358e02d-c931-4ef7-a9ff-2a472c96a01c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:20.758504 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358e02d-c931-4ef7-a9ff-2a472c96a01c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:20.759242 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358e02d-c931-4ef7-a9ff-2a472c96a01c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:20.806799 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72683cf-a46b-4128-a8f6-8fa02734cb6a None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:20.852019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe0b91-4b94-4668-9f6a-1b677c71e668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:20.852801 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe0b91-4b94-4668-9f6a-1b677c71e668 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:20.853099 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe0b91-4b94-4668-9f6a-1b677c71e668 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:20.853861 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe0b91-4b94-4668-9f6a-1b677c71e668 None admin] PATH_INFO: `/v3/users/202e3f4635df4dfca22906fc29c21b69` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:20.855400 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe0b91-4b94-4668-9f6a-1b677c71e668 None admin] RBAC: Authorizing `identity:get_user(user_id=202e3f4635df4dfca22906fc29c21b69)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:20.857830 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe0b91-4b94-4668-9f6a-1b677c71e668 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:20.860056 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 42/88] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:20 2022] GET /identity/v3/users/202e3f4635df4dfca22906fc29c21b69 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:20.861134 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe0b91-4b94-4668-9f6a-1b677c71e668 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:20.861677 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358e02d-c931-4ef7-a9ff-2a472c96a01c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:20.863346 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358e02d-c931-4ef7-a9ff-2a472c96a01c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:20.901955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:21.003091 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 47/89] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:03:21.006231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358e02d-c931-4ef7-a9ff-2a472c96a01c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:21.022843 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe0b91-4b94-4668-9f6a-1b677c71e668 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:21.037362 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:21.076036 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89532234-eaa7-4e37-95b8-407641265843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:21.077468 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89532234-eaa7-4e37-95b8-407641265843 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:21.077893 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89532234-eaa7-4e37-95b8-407641265843 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:21.078303 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89532234-eaa7-4e37-95b8-407641265843 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:21.141240 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358e02d-c931-4ef7-a9ff-2a472c96a01c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:21.168407 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89532234-eaa7-4e37-95b8-407641265843 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:21.169932 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89532234-eaa7-4e37-95b8-407641265843 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:21.182523 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:21.197672 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99405860-65ca-4790-8705-9fc7cd0528e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:21.198295 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99405860-65ca-4790-8705-9fc7cd0528e9 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:21.198580 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99405860-65ca-4790-8705-9fc7cd0528e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:21.198986 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99405860-65ca-4790-8705-9fc7cd0528e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:21.324439 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99405860-65ca-4790-8705-9fc7cd0528e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:21.327529 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99405860-65ca-4790-8705-9fc7cd0528e9 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:21.353638 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 43/90] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:03:21.354874 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89532234-eaa7-4e37-95b8-407641265843 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:21.374563 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:21.514783 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 48/91] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:03:21.516049 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99405860-65ca-4790-8705-9fc7cd0528e9 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:21.547155 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89532234-eaa7-4e37-95b8-407641265843 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:21.570656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:21.618812 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a62624-d534-418d-87fa-b930c81b9ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:21.619805 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a62624-d534-418d-87fa-b930c81b9ee6 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:21.620275 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a62624-d534-418d-87fa-b930c81b9ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:21.620751 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a62624-d534-418d-87fa-b930c81b9ee6 None admin] PATH_INFO: `/v3/projects/b8c35869b0184f978d0e9bb42b22ad27` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:21.622718 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a62624-d534-418d-87fa-b930c81b9ee6 None admin] RBAC: Authorizing `identity:get_project(project_id=b8c35869b0184f978d0e9bb42b22ad27)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:21.625325 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a62624-d534-418d-87fa-b930c81b9ee6 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:21.627328 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 44/92] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:21 2022] GET /identity/v3/projects/b8c35869b0184f978d0e9bb42b22ad27 => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:21.629833 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a62624-d534-418d-87fa-b930c81b9ee6 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:21.711262 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99405860-65ca-4790-8705-9fc7cd0528e9 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:21.767154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b91a2-221d-4a44-a816-c77003d025af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:21.768158 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b91a2-221d-4a44-a816-c77003d025af None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:21.768645 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b91a2-221d-4a44-a816-c77003d025af None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:21.769102 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b91a2-221d-4a44-a816-c77003d025af None admin] PATH_INFO: `/v3/projects/b8c35869b0184f978d0e9bb42b22ad27` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:21.771586 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b91a2-221d-4a44-a816-c77003d025af None admin] RBAC: Authorizing `identity:get_project(project_id=b8c35869b0184f978d0e9bb42b22ad27)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:21.773254 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b91a2-221d-4a44-a816-c77003d025af None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:21.775099 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 49/93] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:21 2022] GET /identity/v3/projects/b8c35869b0184f978d0e9bb42b22ad27 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:21.776055 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b91a2-221d-4a44-a816-c77003d025af None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:21.776588 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:21.827437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a62624-d534-418d-87fa-b930c81b9ee6 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:21.910982 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b91a2-221d-4a44-a816-c77003d025af None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:21.914968 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:21.933842 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27f254-da56-425c-8395-764a72ec7512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:21.934500 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27f254-da56-425c-8395-764a72ec7512 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:21.934814 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27f254-da56-425c-8395-764a72ec7512 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:21.935094 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27f254-da56-425c-8395-764a72ec7512 None admin] PATH_INFO: `/v3/projects/c2661b95d4da4aedb93aaa77559c83c3` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:21.937055 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27f254-da56-425c-8395-764a72ec7512 None admin] RBAC: Authorizing `identity:get_project(project_id=c2661b95d4da4aedb93aaa77559c83c3)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:21.938674 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27f254-da56-425c-8395-764a72ec7512 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:21.941486 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 45/94] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:21 2022] GET /identity/v3/projects/c2661b95d4da4aedb93aaa77559c83c3 => generated 312 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:21.944040 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27f254-da56-425c-8395-764a72ec7512 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:21.968756 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae4043-d560-4e0b-83b8-330bbfafef0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:21.969742 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae4043-d560-4e0b-83b8-330bbfafef0b None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:21.970214 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae4043-d560-4e0b-83b8-330bbfafef0b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:21.970700 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae4043-d560-4e0b-83b8-330bbfafef0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:21.971694 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae4043-d560-4e0b-83b8-330bbfafef0b None admin] RBAC: Adding query filter params (role.id=5609ac7373ba400593bba6d811e3aa72, scope.project.id=b8c35869b0184f978d0e9bb42b22ad27, user.id=e8c852aa86d546e6891e0dac7b3ec7f8) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:21.972930 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae4043-d560-4e0b-83b8-330bbfafef0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:21.975269 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae4043-d560-4e0b-83b8-330bbfafef0b None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:21.985569 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 50/95] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:21 2022] GET /identity/v3/role_assignments?user.id=e8c852aa86d546e6891e0dac7b3ec7f8&scope.project.id=b8c35869b0184f978d0e9bb42b22ad27&role.id=5609ac7373ba400593bba6d811e3aa72 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:21.986433 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae4043-d560-4e0b-83b8-330bbfafef0b None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:22.188791 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27f254-da56-425c-8395-764a72ec7512 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:22.225667 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae4043-d560-4e0b-83b8-330bbfafef0b None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:22.247518 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a807dfc-3efb-493e-bb0a-7deb244e8c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:22.249651 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a807dfc-3efb-493e-bb0a-7deb244e8c44 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:22.249936 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a807dfc-3efb-493e-bb0a-7deb244e8c44 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:22.250215 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a807dfc-3efb-493e-bb0a-7deb244e8c44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:22.251886 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a807dfc-3efb-493e-bb0a-7deb244e8c44 None admin] RBAC: Adding query filter params (role.id=f396be01985a422c96d757a4c77a1fb1, scope.project.id=b8c35869b0184f978d0e9bb42b22ad27, user.id=202e3f4635df4dfca22906fc29c21b69) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:22.252204 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a807dfc-3efb-493e-bb0a-7deb244e8c44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:22.253699 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a807dfc-3efb-493e-bb0a-7deb244e8c44 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:22.267481 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 46/96] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:21 2022] GET /identity/v3/role_assignments?user.id=202e3f4635df4dfca22906fc29c21b69&scope.project.id=b8c35869b0184f978d0e9bb42b22ad27&role.id=f396be01985a422c96d757a4c77a1fb1 => generated 259 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:22.283941 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893a4f4-669e-467c-81cf-d912370d9287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:22.284569 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893a4f4-669e-467c-81cf-d912370d9287 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:22.284913 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893a4f4-669e-467c-81cf-d912370d9287 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:22.285194 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893a4f4-669e-467c-81cf-d912370d9287 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:22.286110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893a4f4-669e-467c-81cf-d912370d9287 None admin] RBAC: Adding query filter params (role.id=ab14a68bf5b54561badd35b83e6acaf5, scope.project.id=c2661b95d4da4aedb93aaa77559c83c3, user.id=202e3f4635df4dfca22906fc29c21b69) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:22.286426 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893a4f4-669e-467c-81cf-d912370d9287 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:22.287968 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893a4f4-669e-467c-81cf-d912370d9287 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:22.294836 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 51/97] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:21 2022] GET /identity/v3/role_assignments?user.id=202e3f4635df4dfca22906fc29c21b69&scope.project.id=c2661b95d4da4aedb93aaa77559c83c3&role.id=ab14a68bf5b54561badd35b83e6acaf5 => generated 259 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:23.849436 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7497387-38ba-4557-9df9-564f3b32e7f3 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:23.849969 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7497387-38ba-4557-9df9-564f3b32e7f3 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:23.849969 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7497387-38ba-4557-9df9-564f3b32e7f3 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:23.851543 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 47/98] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:23.862124 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ac119-c973-494d-baf9-a8f3f5bd2d63 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:23.862590 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ac119-c973-494d-baf9-a8f3f5bd2d63 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:23.862688 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ac119-c973-494d-baf9-a8f3f5bd2d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:23.889503 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-a88ac119-c973-494d-baf9-a8f3f5bd2d63 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:23.890731 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-a88ac119-c973-494d-baf9-a8f3f5bd2d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:23.913253 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:23.984324 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 52/99] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:24.212223 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298beedf-ac07-4cb0-8430-056f45deca4b None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:24.212604 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298beedf-ac07-4cb0-8430-056f45deca4b None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:24.212781 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298beedf-ac07-4cb0-8430-056f45deca4b None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:24.214116 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 48/100] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:24.232614 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89e108-416f-4c2c-90dc-7d363d23f402 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:24.232895 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89e108-416f-4c2c-90dc-7d363d23f402 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:24.233177 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89e108-416f-4c2c-90dc-7d363d23f402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:24.255590 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef1706-f84e-4d10-92a6-9f395173604c None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:24.255859 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef1706-f84e-4d10-92a6-9f395173604c None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:24.256061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef1706-f84e-4d10-92a6-9f395173604c None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:24.257570 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 49/101] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:24.263675 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-fe89e108-416f-4c2c-90dc-7d363d23f402 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:24.265503 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29636f33-5243-4b6c-ac0f-bdcd0993080e None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:24.265787 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29636f33-5243-4b6c-ac0f-bdcd0993080e None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:24.266061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29636f33-5243-4b6c-ac0f-bdcd0993080e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:24.273117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-fe89e108-416f-4c2c-90dc-7d363d23f402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:24.294038 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-29636f33-5243-4b6c-ac0f-bdcd0993080e None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:24.295308 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-29636f33-5243-4b6c-ac0f-bdcd0993080e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:24.298913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:24.406156 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 53/102] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:24.443077 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 50/103] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:03:24.568828 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89e108-416f-4c2c-90dc-7d363d23f402 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:24.685083 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:24.708559 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89e108-416f-4c2c-90dc-7d363d23f402 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:24.744147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbb17b-6dee-42af-823c-fd4a0ce9f5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:24.744837 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbb17b-6dee-42af-823c-fd4a0ce9f5a5 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:24.745127 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbb17b-6dee-42af-823c-fd4a0ce9f5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:24.745403 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fbb17b-6dee-42af-823c-fd4a0ce9f5a5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:24.756979 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fbb17b-6dee-42af-823c-fd4a0ce9f5a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:24.763514 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-67fbb17b-6dee-42af-823c-fd4a0ce9f5a5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:03:24.763514 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:24.763514 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:24.763514 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:24.763514 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:24.763514 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:24.763514 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:24.763514 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:24.763514 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:24.763514 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:24.763514 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:24.763514 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:24.763514 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:24.763514 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:24.763514 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:24.763514 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:24.764395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:24.764395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:24.764395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:24.764395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:24.764395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:24.764395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:24.764395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:24.764395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:24.764395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:24.764395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:24.764395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:24.764395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:24.764395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:24.764395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:24.764395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:24.764395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:24.765148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:24.765148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:24.765148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:24.765148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:24.765148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:24.765148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:24.765148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:24.765148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:24.765148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:24.765148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:24.765148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:03:24.765148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:03:24.765148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 54/104] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:24.772289 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29636f33-5243-4b6c-ac0f-bdcd0993080e None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:24.899606 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29636f33-5243-4b6c-ac0f-bdcd0993080e None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:24.945113 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18543b-a38f-48a0-903a-39aab3656f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:24.945806 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18543b-a38f-48a0-903a-39aab3656f66 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:24.946098 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18543b-a38f-48a0-903a-39aab3656f66 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:24.946377 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18543b-a38f-48a0-903a-39aab3656f66 None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:24.947097 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18543b-a38f-48a0-903a-39aab3656f66 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:24.947388 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbb17b-6dee-42af-823c-fd4a0ce9f5a5 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:24.947815 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18543b-a38f-48a0-903a-39aab3656f66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:24.948836 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18543b-a38f-48a0-903a-39aab3656f66 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:24.958642 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:24.961993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 51/105] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:03:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:24.970717 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18543b-a38f-48a0-903a-39aab3656f66 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:25.088984 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fbb17b-6dee-42af-823c-fd4a0ce9f5a5 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:25.131383 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf4044-b52e-42dd-b5cc-71d1921dc50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:25.132413 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf4044-b52e-42dd-b5cc-71d1921dc50e None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:25.133081 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf4044-b52e-42dd-b5cc-71d1921dc50e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:25.133555 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf4044-b52e-42dd-b5cc-71d1921dc50e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:25.157963 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf4044-b52e-42dd-b5cc-71d1921dc50e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:25.164647 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-6ecf4044-b52e-42dd-b5cc-71d1921dc50e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:03:25.164647 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:25.164647 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:25.164647 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:25.164647 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:25.164647 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:25.164647 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:25.164647 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:25.164647 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:25.164647 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:25.164647 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:25.164647 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:25.164647 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:25.164647 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:25.164647 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:25.164647 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:25.165838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:25.165838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:25.165838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:25.165838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:25.165838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:25.165838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:25.165838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:25.165838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:25.165838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:25.165838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:25.165838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:25.165838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:25.165838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:25.165838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:25.165838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:25.165838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:25.166602 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:25.166602 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:25.166602 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:25.166602 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:25.166602 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:25.166602 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:25.166602 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:25.166602 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:25.166602 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:25.166602 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:25.166602 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:03:25.166602 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:03:25.175642 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 55/106] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:25.176868 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf4044-b52e-42dd-b5cc-71d1921dc50e None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:25.186947 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:25.208348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18543b-a38f-48a0-903a-39aab3656f66 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:25.284245 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcf715-1485-4d97-97e5-aa5be7457d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:25.285365 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcf715-1485-4d97-97e5-aa5be7457d54 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:25.285853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcf715-1485-4d97-97e5-aa5be7457d54 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:25.286348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcf715-1485-4d97-97e5-aa5be7457d54 None admin] PATH_INFO: `/v3/users/389e2146b19b409ca436c670559712c0` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:25.320705 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcf715-1485-4d97-97e5-aa5be7457d54 None admin] RBAC: Authorizing `identity:get_user(user_id=389e2146b19b409ca436c670559712c0)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:25.322637 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcf715-1485-4d97-97e5-aa5be7457d54 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:25.325093 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 52/107] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:24 2022] GET /identity/v3/users/389e2146b19b409ca436c670559712c0 => generated 289 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:25.326068 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcf715-1485-4d97-97e5-aa5be7457d54 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:25.330945 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf4044-b52e-42dd-b5cc-71d1921dc50e None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:25.368669 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52ba80-06bd-428d-84c7-a27298950e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:25.369313 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52ba80-06bd-428d-84c7-a27298950e2c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:25.369594 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52ba80-06bd-428d-84c7-a27298950e2c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:25.369872 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52ba80-06bd-428d-84c7-a27298950e2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:25.371053 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52ba80-06bd-428d-84c7-a27298950e2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:25.372584 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52ba80-06bd-428d-84c7-a27298950e2c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:25.374400 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 56/108] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:25.375922 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52ba80-06bd-428d-84c7-a27298950e2c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:25.459173 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:25.471032 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:25.491419 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52ba80-06bd-428d-84c7-a27298950e2c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:25.558784 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcf715-1485-4d97-97e5-aa5be7457d54 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:25.561710 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890fa65-c13c-44eb-b069-8fcec87652ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:25.562384 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890fa65-c13c-44eb-b069-8fcec87652ab None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:25.562688 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890fa65-c13c-44eb-b069-8fcec87652ab None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:25.562966 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890fa65-c13c-44eb-b069-8fcec87652ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:25.607586 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9794f1b-57d2-403a-826c-f0880f9c25d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:25.608484 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9794f1b-57d2-403a-826c-f0880f9c25d0 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:25.608772 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9794f1b-57d2-403a-826c-f0880f9c25d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:25.609051 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9794f1b-57d2-403a-826c-f0880f9c25d0 None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:25.609728 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9794f1b-57d2-403a-826c-f0880f9c25d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:25.610184 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9794f1b-57d2-403a-826c-f0880f9c25d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:25.612184 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9794f1b-57d2-403a-826c-f0880f9c25d0 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:25.623613 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 53/109] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:03:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:25.624440 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9794f1b-57d2-403a-826c-f0880f9c25d0 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:25.683782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890fa65-c13c-44eb-b069-8fcec87652ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:25.685618 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890fa65-c13c-44eb-b069-8fcec87652ab None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:25.768642 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:25.788232 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9794f1b-57d2-403a-826c-f0880f9c25d0 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:25.818288 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 57/110] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:03:25.818288 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890fa65-c13c-44eb-b069-8fcec87652ab None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:25.822020 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:25.840558 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074fb9e-b93d-46bb-9b07-4c5b28b7421f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:25.841222 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074fb9e-b93d-46bb-9b07-4c5b28b7421f None admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:25.841504 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074fb9e-b93d-46bb-9b07-4c5b28b7421f None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:25.841833 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074fb9e-b93d-46bb-9b07-4c5b28b7421f None admin] PATH_INFO: `/v3/projects` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:25.842550 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074fb9e-b93d-46bb-9b07-4c5b28b7421f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:25.843998 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074fb9e-b93d-46bb-9b07-4c5b28b7421f None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:25.882795 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 54/111] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Sep 13 12:03:25 2022] POST /identity/v3/projects => generated 302 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:25.884325 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99787228-7ba6-4ae1-bac3-6a6d423c3777 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:25.884618 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99787228-7ba6-4ae1-bac3-6a6d423c3777 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:25.884965 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99787228-7ba6-4ae1-bac3-6a6d423c3777 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:25.886302 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 55/112] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:25.887211 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99787228-7ba6-4ae1-bac3-6a6d423c3777 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:25.947087 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890fa65-c13c-44eb-b069-8fcec87652ab None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:25.993642 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cc56e-ee6d-40ad-aef3-2d766349ea43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:25.995435 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cc56e-ee6d-40ad-aef3-2d766349ea43 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:25.995722 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cc56e-ee6d-40ad-aef3-2d766349ea43 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:25.995998 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cc56e-ee6d-40ad-aef3-2d766349ea43 None admin] PATH_INFO: `/v3/users/202e3f4635df4dfca22906fc29c21b69` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:25.998583 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077cc56e-ee6d-40ad-aef3-2d766349ea43 None admin] RBAC: Authorizing `identity:get_user(user_id=202e3f4635df4dfca22906fc29c21b69)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:26.000087 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077cc56e-ee6d-40ad-aef3-2d766349ea43 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:26.003033 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 58/113] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:25 2022] GET /identity/v3/users/202e3f4635df4dfca22906fc29c21b69 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:26.007991 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6168e5a-83df-42b0-a9e5-1aed961fbc80 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:26.008531 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6168e5a-83df-42b0-a9e5-1aed961fbc80 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:26.009294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6168e5a-83df-42b0-a9e5-1aed961fbc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:26.027932 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99787228-7ba6-4ae1-bac3-6a6d423c3777 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:26.038198 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-e6168e5a-83df-42b0-a9e5-1aed961fbc80 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:26.040510 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-e6168e5a-83df-42b0-a9e5-1aed961fbc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:26.075525 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae90a64-9385-4c32-99a0-dc825123196f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:26.077183 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae90a64-9385-4c32-99a0-dc825123196f None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:26.077930 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae90a64-9385-4c32-99a0-dc825123196f None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:26.078455 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae90a64-9385-4c32-99a0-dc825123196f None admin] PATH_INFO: `/v3/projects/b8c35869b0184f978d0e9bb42b22ad27` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:26.080637 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae90a64-9385-4c32-99a0-dc825123196f None admin] RBAC: Authorizing `identity:get_project(project_id=b8c35869b0184f978d0e9bb42b22ad27)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:26.083167 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae90a64-9385-4c32-99a0-dc825123196f None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:26.084445 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:26.087647 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 56/114] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:25 2022] GET /identity/v3/projects/b8c35869b0184f978d0e9bb42b22ad27 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:26.089347 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ce849-30b5-4a20-be25-6f02214c39f8 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:26.089848 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ce849-30b5-4a20-be25-6f02214c39f8 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:26.090315 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ce849-30b5-4a20-be25-6f02214c39f8 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:26.093057 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 57/115] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:26.094081 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ce849-30b5-4a20-be25-6f02214c39f8 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:26.138714 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 59/116] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:26.139151 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6168e5a-83df-42b0-a9e5-1aed961fbc80 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:26.148423 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:26.231838 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ce849-30b5-4a20-be25-6f02214c39f8 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:26.277631 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4054156-51fb-49ac-8c6e-38da843f3ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:26.278333 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4054156-51fb-49ac-8c6e-38da843f3ce6 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:26.278558 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4054156-51fb-49ac-8c6e-38da843f3ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:26.278886 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4054156-51fb-49ac-8c6e-38da843f3ce6 None admin] PATH_INFO: `/v3/projects/b8c35869b0184f978d0e9bb42b22ad27` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:26.280023 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4054156-51fb-49ac-8c6e-38da843f3ce6 None admin] RBAC: Authorizing `identity:get_project(project_id=b8c35869b0184f978d0e9bb42b22ad27)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:26.281497 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4054156-51fb-49ac-8c6e-38da843f3ce6 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:26.283179 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 58/117] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:26 2022] GET /identity/v3/projects/b8c35869b0184f978d0e9bb42b22ad27 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:26.285077 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6168e5a-83df-42b0-a9e5-1aed961fbc80 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:26.288204 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f2d12-bd27-40c8-8568-5e45caaffe11 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:26.288498 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f2d12-bd27-40c8-8568-5e45caaffe11 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:26.288779 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f2d12-bd27-40c8-8568-5e45caaffe11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:26.311277 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-4e8f2d12-bd27-40c8-8568-5e45caaffe11 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:26.312481 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-4e8f2d12-bd27-40c8-8568-5e45caaffe11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:26.327785 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e53714-0555-4ac5-91cb-16583d1cbfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:26.329174 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e53714-0555-4ac5-91cb-16583d1cbfa7 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:26.329858 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e53714-0555-4ac5-91cb-16583d1cbfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:26.330290 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e53714-0555-4ac5-91cb-16583d1cbfa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:26.331447 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e53714-0555-4ac5-91cb-16583d1cbfa7 None admin] RBAC: Adding query filter params (role.id=5e1d0d5215694636b5147ed0d216c047, scope.project.id=b8c35869b0184f978d0e9bb42b22ad27, user.id=389e2146b19b409ca436c670559712c0) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:26.332813 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e53714-0555-4ac5-91cb-16583d1cbfa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:26.334413 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e53714-0555-4ac5-91cb-16583d1cbfa7 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:26.342039 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 60/118] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:26 2022] GET /identity/v3/role_assignments?user.id=389e2146b19b409ca436c670559712c0&scope.project.id=b8c35869b0184f978d0e9bb42b22ad27&role.id=5e1d0d5215694636b5147ed0d216c047 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:26.343859 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157af9ee-e689-4e36-9d94-9adbf6a46dad None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:26.344570 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157af9ee-e689-4e36-9d94-9adbf6a46dad None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:26.345034 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157af9ee-e689-4e36-9d94-9adbf6a46dad None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:26.347313 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 61/119] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:26.349384 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157af9ee-e689-4e36-9d94-9adbf6a46dad None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:26.418635 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 59/120] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:26.420132 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff6033-09cb-4be1-af36-cdbfe2f552b0 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:26.420543 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff6033-09cb-4be1-af36-cdbfe2f552b0 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:26.421492 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff6033-09cb-4be1-af36-cdbfe2f552b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:26.428837 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:26.449798 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-7cff6033-09cb-4be1-af36-cdbfe2f552b0 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:26.451846 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-7cff6033-09cb-4be1-af36-cdbfe2f552b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:26.489246 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:26.551843 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 60/121] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:26.568020 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff6033-09cb-4be1-af36-cdbfe2f552b0 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:26.626639 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157af9ee-e689-4e36-9d94-9adbf6a46dad None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:26.690773 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c05d10-9e74-4b8a-b837-53098225a6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:26.691498 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c05d10-9e74-4b8a-b837-53098225a6cf None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:26.691787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c05d10-9e74-4b8a-b837-53098225a6cf None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:26.692228 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c05d10-9e74-4b8a-b837-53098225a6cf None admin] PATH_INFO: `/v3/projects/b8c35869b0184f978d0e9bb42b22ad27/users/202e3f4635df4dfca22906fc29c21b69/roles/ab14a68bf5b54561badd35b83e6acaf5` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:26.694199 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c05d10-9e74-4b8a-b837-53098225a6cf None admin] RBAC: Authorizing `identity:create_grant(project_id=b8c35869b0184f978d0e9bb42b22ad27, user_id=202e3f4635df4dfca22906fc29c21b69, role_id=ab14a68bf5b54561badd35b83e6acaf5)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:26.695888 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c05d10-9e74-4b8a-b837-53098225a6cf None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:26.717421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 62/122] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Sep 13 12:03:26 2022] PUT /identity/v3/projects/b8c35869b0184f978d0e9bb42b22ad27/users/202e3f4635df4dfca22906fc29c21b69/roles/ab14a68bf5b54561badd35b83e6acaf5 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:03:26.762318 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff6033-09cb-4be1-af36-cdbfe2f552b0 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:26.814862 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cea1cc-25ae-423b-b6c2-2ca3ab790314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:26.815471 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cea1cc-25ae-423b-b6c2-2ca3ab790314 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:26.815797 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cea1cc-25ae-423b-b6c2-2ca3ab790314 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:26.816128 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cea1cc-25ae-423b-b6c2-2ca3ab790314 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:26.829516 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cea1cc-25ae-423b-b6c2-2ca3ab790314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:26.835356 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-40cea1cc-25ae-423b-b6c2-2ca3ab790314 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:26.835356 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:26.835356 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:26.835356 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:26.835356 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:26.835356 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:26.835356 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:26.835356 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:26.835356 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:26.835356 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:26.835356 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:26.835356 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:26.835356 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:26.835356 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:26.835356 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:26.835356 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:26.836273 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:26.836273 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:26.836273 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:26.836273 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:26.836273 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:26.836273 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:26.836273 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:26.836273 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:26.836273 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:26.836273 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:26.836273 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:26.836273 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:26.836273 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:26.836273 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:26.836273 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:26.836273 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:26.837056 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:26.837056 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:26.837056 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:26.837056 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:26.837056 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:26.837056 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:26.837056 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:26.837056 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:26.837056 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:26.837056 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:26.837056 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:26.837056 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:03:26.837056 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 61/123] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Sep 13 12:03:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:26.843739 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c05d10-9e74-4b8a-b837-53098225a6cf None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:27.002670 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:27.012822 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c05d10-9e74-4b8a-b837-53098225a6cf None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:27.060689 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d79ba-94f8-448c-9788-a5a4405d7f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:27.061321 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d79ba-94f8-448c-9788-a5a4405d7f02 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:27.061590 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d79ba-94f8-448c-9788-a5a4405d7f02 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:27.061866 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d79ba-94f8-448c-9788-a5a4405d7f02 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:27.062538 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d79ba-94f8-448c-9788-a5a4405d7f02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:27.062874 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d79ba-94f8-448c-9788-a5a4405d7f02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:27.064250 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d79ba-94f8-448c-9788-a5a4405d7f02 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:27.075636 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cea1cc-25ae-423b-b6c2-2ca3ab790314 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:27.082904 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 63/124] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:27.091134 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d79ba-94f8-448c-9788-a5a4405d7f02 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:27.142973 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:27.222216 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d79ba-94f8-448c-9788-a5a4405d7f02 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:27.244966 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cea1cc-25ae-423b-b6c2-2ca3ab790314 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:27.260948 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9799087-f914-459e-acb3-3478ec05b8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:27.261747 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9799087-f914-459e-acb3-3478ec05b8e2 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:27.262033 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9799087-f914-459e-acb3-3478ec05b8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:27.262310 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9799087-f914-459e-acb3-3478ec05b8e2 None admin] PATH_INFO: `/v3/users/e8c852aa86d546e6891e0dac7b3ec7f8` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:27.264274 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9799087-f914-459e-acb3-3478ec05b8e2 None admin] RBAC: Authorizing `identity:get_user(user_id=e8c852aa86d546e6891e0dac7b3ec7f8)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:27.265726 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9799087-f914-459e-acb3-3478ec05b8e2 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:27.273316 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 64/125] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:27 2022] GET /identity/v3/users/e8c852aa86d546e6891e0dac7b3ec7f8 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:27.274199 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9799087-f914-459e-acb3-3478ec05b8e2 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:27.288255 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3e56f-4c11-49af-8edc-73a7e6d2e08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:27.288894 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3e56f-4c11-49af-8edc-73a7e6d2e08a None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:27.289176 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3e56f-4c11-49af-8edc-73a7e6d2e08a None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:27.289450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3e56f-4c11-49af-8edc-73a7e6d2e08a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:27.308267 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3e56f-4c11-49af-8edc-73a7e6d2e08a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:27.313158 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-24c3e56f-4c11-49af-8edc-73a7e6d2e08a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:03:27.313158 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:27.313158 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:27.313158 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:27.313158 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:27.313158 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:27.313158 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:27.313158 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:27.313158 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:27.313158 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:27.313158 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:27.313158 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:27.313158 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:27.313158 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:27.313158 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:27.313158 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:27.314002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:27.314002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:27.314002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:27.314002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:27.314002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:27.314002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:27.314002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:27.314002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:27.314002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:27.314002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:27.314002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:27.314002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:27.314002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:27.314002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:27.314002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:27.314002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:27.314809 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:27.314809 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:27.314809 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:27.314809 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:27.314809 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:27.314809 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:27.314809 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:27.314809 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:27.314809 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:27.314809 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:27.314809 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:03:27.314809 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:03:27.320690 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 62/126] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Sep 13 12:03:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:27.321554 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3e56f-4c11-49af-8edc-73a7e6d2e08a None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:27.325549 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:27.470637 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9799087-f914-459e-acb3-3478ec05b8e2 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:27.483157 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:27.501355 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3e56f-4c11-49af-8edc-73a7e6d2e08a None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:27.540831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2dfec-8821-4e98-b7b8-2179184b3998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:27.541482 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2dfec-8821-4e98-b7b8-2179184b3998 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:27.541770 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2dfec-8821-4e98-b7b8-2179184b3998 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:27.542045 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2dfec-8821-4e98-b7b8-2179184b3998 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:27.563032 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2dfec-8821-4e98-b7b8-2179184b3998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:27.572147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-c8e2dfec-8821-4e98-b7b8-2179184b3998 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:03:27.572147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:27.572147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:27.572147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:27.572147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:27.572147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:27.572147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:27.572147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:27.572147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:27.572147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:27.572147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:27.572147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:27.572147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:27.572147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:27.572147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:27.572147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:27.573051 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:27.573051 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:27.573051 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:27.573051 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:27.573051 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:27.573051 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:27.573051 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:27.573051 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:27.573051 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:27.573051 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:27.573051 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:27.573051 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:27.573051 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:27.573051 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:27.573051 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:27.573051 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:27.573814 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:27.573814 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:27.573814 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:27.573814 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:27.573814 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:27.573814 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:27.573814 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:27.573814 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:27.573814 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:27.573814 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:27.573814 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:03:27.573814 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:03:27.573814 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 65/127] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:27.574555 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2dfec-8821-4e98-b7b8-2179184b3998 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:27.575222 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a15e0-0f02-4b83-b5ca-a7312f6a4e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:27.578637 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a15e0-0f02-4b83-b5ca-a7312f6a4e14 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:27.578637 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a15e0-0f02-4b83-b5ca-a7312f6a4e14 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:27.580944 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a15e0-0f02-4b83-b5ca-a7312f6a4e14 None admin] PATH_INFO: `/v3/projects/b8c35869b0184f978d0e9bb42b22ad27` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:27.583345 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a15e0-0f02-4b83-b5ca-a7312f6a4e14 None admin] RBAC: Authorizing `identity:get_project(project_id=b8c35869b0184f978d0e9bb42b22ad27)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:27.584851 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a15e0-0f02-4b83-b5ca-a7312f6a4e14 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:27.586540 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 63/128] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:27 2022] GET /identity/v3/projects/b8c35869b0184f978d0e9bb42b22ad27 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:27.587345 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a15e0-0f02-4b83-b5ca-a7312f6a4e14 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:27.755045 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:27.791648 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2dfec-8821-4e98-b7b8-2179184b3998 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:27.804585 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a15e0-0f02-4b83-b5ca-a7312f6a4e14 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:27.835114 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd9dc4-7161-4155-aa17-fddfa9c60338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:27.835736 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd9dc4-7161-4155-aa17-fddfa9c60338 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:27.836014 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd9dc4-7161-4155-aa17-fddfa9c60338 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:27.836283 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd9dc4-7161-4155-aa17-fddfa9c60338 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:27.836954 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd9dc4-7161-4155-aa17-fddfa9c60338 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:27.837255 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd9dc4-7161-4155-aa17-fddfa9c60338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:27.838668 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd9dc4-7161-4155-aa17-fddfa9c60338 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:27.858886 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 66/129] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:27.867447 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd9dc4-7161-4155-aa17-fddfa9c60338 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:27.890935 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f7091-f9a2-4bcb-b28a-7c4099e91fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:27.891551 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f7091-f9a2-4bcb-b28a-7c4099e91fe0 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:27.891830 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f7091-f9a2-4bcb-b28a-7c4099e91fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:27.892102 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f7091-f9a2-4bcb-b28a-7c4099e91fe0 None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:27.892770 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f7091-f9a2-4bcb-b28a-7c4099e91fe0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:27.893071 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f7091-f9a2-4bcb-b28a-7c4099e91fe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:27.894500 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f7091-f9a2-4bcb-b28a-7c4099e91fe0 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:27.913120 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 64/130] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:03:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:27.913810 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f7091-f9a2-4bcb-b28a-7c4099e91fe0 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:27.951011 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:28.011542 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd9dc4-7161-4155-aa17-fddfa9c60338 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:28.050077 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b5414-c248-4d63-9df2-c28353b2e18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:28.052189 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5414-c248-4d63-9df2-c28353b2e18a None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:28.053149 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5414-c248-4d63-9df2-c28353b2e18a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:28.057682 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b5414-c248-4d63-9df2-c28353b2e18a None admin] PATH_INFO: `/v3/projects/b8c35869b0184f978d0e9bb42b22ad27/users/e8c852aa86d546e6891e0dac7b3ec7f8/roles/5609ac7373ba400593bba6d811e3aa72` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:28.061105 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b5414-c248-4d63-9df2-c28353b2e18a None admin] RBAC: Authorizing `identity:create_grant(project_id=b8c35869b0184f978d0e9bb42b22ad27, user_id=e8c852aa86d546e6891e0dac7b3ec7f8, role_id=5609ac7373ba400593bba6d811e3aa72)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:28.062566 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b5414-c248-4d63-9df2-c28353b2e18a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:28.066763 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f7091-f9a2-4bcb-b28a-7c4099e91fe0 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:28.105771 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 67/131] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Sep 13 12:03:27 2022] PUT /identity/v3/projects/b8c35869b0184f978d0e9bb42b22ad27/users/e8c852aa86d546e6891e0dac7b3ec7f8/roles/5609ac7373ba400593bba6d811e3aa72 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:03:28.106839 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661bc3c-1490-435b-b9e0-498c156b937f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:28.107443 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b5414-c248-4d63-9df2-c28353b2e18a None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:28.107724 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661bc3c-1490-435b-b9e0-498c156b937f None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:28.108105 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661bc3c-1490-435b-b9e0-498c156b937f None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:28.108652 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661bc3c-1490-435b-b9e0-498c156b937f None admin] PATH_INFO: `/v3/users/202e3f4635df4dfca22906fc29c21b69` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:28.110027 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661bc3c-1490-435b-b9e0-498c156b937f None admin] RBAC: Authorizing `identity:get_user(user_id=202e3f4635df4dfca22906fc29c21b69)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:28.114556 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661bc3c-1490-435b-b9e0-498c156b937f None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:28.114556 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 65/132] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:27 2022] GET /identity/v3/users/202e3f4635df4dfca22906fc29c21b69 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:28.116436 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:28.124051 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661bc3c-1490-435b-b9e0-498c156b937f None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:28.311037 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:28.343430 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661bc3c-1490-435b-b9e0-498c156b937f None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:28.405098 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aded776-4289-4e54-af63-0636001fb546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:28.405735 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aded776-4289-4e54-af63-0636001fb546 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:28.406019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aded776-4289-4e54-af63-0636001fb546 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:28.406296 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aded776-4289-4e54-af63-0636001fb546 None admin] PATH_INFO: `/v3/projects/b8c35869b0184f978d0e9bb42b22ad27` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:28.407494 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aded776-4289-4e54-af63-0636001fb546 None admin] RBAC: Authorizing `identity:get_project(project_id=b8c35869b0184f978d0e9bb42b22ad27)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:28.409180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aded776-4289-4e54-af63-0636001fb546 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:28.411456 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 66/133] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:28 2022] GET /identity/v3/projects/b8c35869b0184f978d0e9bb42b22ad27 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:28.420679 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aded776-4289-4e54-af63-0636001fb546 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:28.456654 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b5414-c248-4d63-9df2-c28353b2e18a None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:28.547952 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02511e4-1c64-4201-ac26-14d3472feb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:28.548619 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02511e4-1c64-4201-ac26-14d3472feb9d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:28.548910 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02511e4-1c64-4201-ac26-14d3472feb9d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:28.549188 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02511e4-1c64-4201-ac26-14d3472feb9d None admin] PATH_INFO: `/v3/users/202e3f4635df4dfca22906fc29c21b69` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:28.550354 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02511e4-1c64-4201-ac26-14d3472feb9d None admin] RBAC: Authorizing `identity:get_user(user_id=202e3f4635df4dfca22906fc29c21b69)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:28.552134 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02511e4-1c64-4201-ac26-14d3472feb9d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:28.554212 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 68/134] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:28 2022] GET /identity/v3/users/202e3f4635df4dfca22906fc29c21b69 => generated 275 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:28.560440 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02511e4-1c64-4201-ac26-14d3472feb9d None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:28.622573 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aded776-4289-4e54-af63-0636001fb546 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:28.696980 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:28.727377 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7ebcc-1286-45c9-a876-e3189ef5ff5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:28.728063 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7ebcc-1286-45c9-a876-e3189ef5ff5e None admin] REQUEST_METHOD: `PUT` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:28.728351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7ebcc-1286-45c9-a876-e3189ef5ff5e None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:28.728632 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7ebcc-1286-45c9-a876-e3189ef5ff5e None admin] PATH_INFO: `/v3/projects/b8c35869b0184f978d0e9bb42b22ad27/users/202e3f4635df4dfca22906fc29c21b69/roles/f396be01985a422c96d757a4c77a1fb1` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:28.736020 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7ebcc-1286-45c9-a876-e3189ef5ff5e None admin] RBAC: Authorizing `identity:create_grant(project_id=b8c35869b0184f978d0e9bb42b22ad27, user_id=202e3f4635df4dfca22906fc29c21b69, role_id=f396be01985a422c96d757a4c77a1fb1)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:28.737502 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7ebcc-1286-45c9-a876-e3189ef5ff5e None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:28.743987 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02511e4-1c64-4201-ac26-14d3472feb9d None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:28.781558 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 67/135] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Sep 13 12:03:28 2022] PUT /identity/v3/projects/b8c35869b0184f978d0e9bb42b22ad27/users/202e3f4635df4dfca22906fc29c21b69/roles/f396be01985a422c96d757a4c77a1fb1 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:03:28.804002 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10a32a-b809-4fd6-9d2f-fb91cc5bffcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:28.804685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10a32a-b809-4fd6-9d2f-fb91cc5bffcb None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:28.804972 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10a32a-b809-4fd6-9d2f-fb91cc5bffcb None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:28.805256 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10a32a-b809-4fd6-9d2f-fb91cc5bffcb None admin] PATH_INFO: `/v3/projects/c2661b95d4da4aedb93aaa77559c83c3` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:28.806447 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10a32a-b809-4fd6-9d2f-fb91cc5bffcb None admin] RBAC: Authorizing `identity:get_project(project_id=c2661b95d4da4aedb93aaa77559c83c3)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:28.807941 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10a32a-b809-4fd6-9d2f-fb91cc5bffcb None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:28.809615 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 69/136] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:28 2022] GET /identity/v3/projects/c2661b95d4da4aedb93aaa77559c83c3 => generated 312 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:28.815840 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7ebcc-1286-45c9-a876-e3189ef5ff5e None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:28.856000 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:28.976217 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938b97b-caa1-41a9-94d9-b1ca63221cc1 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:28.976506 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938b97b-caa1-41a9-94d9-b1ca63221cc1 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:28.976703 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938b97b-caa1-41a9-94d9-b1ca63221cc1 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:28.978039 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 70/137] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:03:28.996219 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12538f-1ea4-4800-9f23-2bacf058d04b None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:28.996573 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12538f-1ea4-4800-9f23-2bacf058d04b None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:28.996778 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12538f-1ea4-4800-9f23-2bacf058d04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:29.016183 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7ebcc-1286-45c9-a876-e3189ef5ff5e None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:29.031821 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-9d12538f-1ea4-4800-9f23-2bacf058d04b None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:29.033148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-9d12538f-1ea4-4800-9f23-2bacf058d04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:29.086111 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9214fc8-3c59-499f-9a36-ca54d3e3896f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:29.087222 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9214fc8-3c59-499f-9a36-ca54d3e3896f None admin] REQUEST_METHOD: `PUT` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:29.087720 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9214fc8-3c59-499f-9a36-ca54d3e3896f None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:29.088195 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9214fc8-3c59-499f-9a36-ca54d3e3896f None admin] PATH_INFO: `/v3/projects/c2661b95d4da4aedb93aaa77559c83c3/users/202e3f4635df4dfca22906fc29c21b69/roles/ab14a68bf5b54561badd35b83e6acaf5` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:29.095652 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9214fc8-3c59-499f-9a36-ca54d3e3896f None admin] RBAC: Authorizing `identity:create_grant(project_id=c2661b95d4da4aedb93aaa77559c83c3, user_id=202e3f4635df4dfca22906fc29c21b69, role_id=ab14a68bf5b54561badd35b83e6acaf5)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:29.097744 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9214fc8-3c59-499f-9a36-ca54d3e3896f None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:29.127702 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 68/138] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Sep 13 12:03:28 2022] PUT /identity/v3/projects/c2661b95d4da4aedb93aaa77559c83c3/users/202e3f4635df4dfca22906fc29c21b69/roles/ab14a68bf5b54561badd35b83e6acaf5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:03:29.166148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 71/139] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:29.565276 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9214fc8-3c59-499f-9a36-ca54d3e3896f None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:29.666300 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:29.723309 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee9d9b-320f-4db0-ae41-309109f8893e None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:29.724182 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee9d9b-320f-4db0-ae41-309109f8893e None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:29.724655 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee9d9b-320f-4db0-ae41-309109f8893e None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:29.726179 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 72/140] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:03:29.731348 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa4d81-77e4-414f-89d1-caefc7215bc7 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:29.731879 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa4d81-77e4-414f-89d1-caefc7215bc7 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:29.732347 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa4d81-77e4-414f-89d1-caefc7215bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:29.735305 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9214fc8-3c59-499f-9a36-ca54d3e3896f None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:29.766589 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-1bfa4d81-77e4-414f-89d1-caefc7215bc7 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:29.768214 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-1bfa4d81-77e4-414f-89d1-caefc7215bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:29.807615 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fb4ad-a818-4c34-9802-76bf92af23f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:29.808294 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fb4ad-a818-4c34-9802-76bf92af23f3 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:29.808584 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fb4ad-a818-4c34-9802-76bf92af23f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:29.808867 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fb4ad-a818-4c34-9802-76bf92af23f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:29.810266 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6fb4ad-a818-4c34-9802-76bf92af23f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:29.812033 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6fb4ad-a818-4c34-9802-76bf92af23f3 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:29.814167 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 69/141] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:29.820658 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fb4ad-a818-4c34-9802-76bf92af23f3 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:29.934993 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:29.948289 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 73/142] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:03:29.981174 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fb4ad-a818-4c34-9802-76bf92af23f3 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:30.023000 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277bdbe-4a5d-493d-b5d7-81effd4e70cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:30.023629 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277bdbe-4a5d-493d-b5d7-81effd4e70cd None admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:30.023915 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277bdbe-4a5d-493d-b5d7-81effd4e70cd None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:30.024188 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277bdbe-4a5d-493d-b5d7-81effd4e70cd None admin] PATH_INFO: `/v3/users` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:30.024860 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277bdbe-4a5d-493d-b5d7-81effd4e70cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:30.026327 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277bdbe-4a5d-493d-b5d7-81effd4e70cd None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:30.048654 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:30.056556 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 70/143] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Sep 13 12:03:29 2022] POST /identity/v3/users => generated 283 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:30.539941 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa4d81-77e4-414f-89d1-caefc7215bc7 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:30.552278 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a3c31-31cb-49b5-b60e-fa7716ef8c89 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:30.553434 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a3c31-31cb-49b5-b60e-fa7716ef8c89 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:30.553910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a3c31-31cb-49b5-b60e-fa7716ef8c89 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:30.555592 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 71/144] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:03:30.561526 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e3f5b-722d-468f-b41b-5e797ff44aa0 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:30.562054 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e3f5b-722d-468f-b41b-5e797ff44aa0 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:30.562531 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e3f5b-722d-468f-b41b-5e797ff44aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:30.594586 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-ac4e3f5b-722d-468f-b41b-5e797ff44aa0 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:30.596145 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-ac4e3f5b-722d-468f-b41b-5e797ff44aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:30.672844 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa4d81-77e4-414f-89d1-caefc7215bc7 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:30.742836 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 72/145] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:03:30.747869 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55486f0-6999-45ea-83bd-8c472810f156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:30.748523 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55486f0-6999-45ea-83bd-8c472810f156 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:30.748811 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55486f0-6999-45ea-83bd-8c472810f156 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:30.749089 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55486f0-6999-45ea-83bd-8c472810f156 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:30.767527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55486f0-6999-45ea-83bd-8c472810f156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:30.773083 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-c55486f0-6999-45ea-83bd-8c472810f156 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:03:30.773083 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:30.773083 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:30.773083 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:30.773083 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:30.773083 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:30.773083 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:30.773083 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:30.773083 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:30.773083 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:30.773083 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:30.773083 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:30.773083 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:30.773083 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:30.773083 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:30.773083 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:30.773916 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:30.773916 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:30.773916 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:30.773916 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:30.773916 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:30.773916 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:30.773916 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:30.773916 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:30.773916 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:30.773916 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:30.773916 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:30.773916 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:30.773916 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:30.773916 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:30.773916 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:30.773916 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:30.775117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:30.775117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:30.775117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:30.775117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:30.775117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:30.775117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:30.775117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:30.775117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:30.775117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:30.775117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:30.775117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:03:30.775117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:03:30.775117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 74/146] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:30.782273 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e3f5b-722d-468f-b41b-5e797ff44aa0 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:30.937948 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e3f5b-722d-468f-b41b-5e797ff44aa0 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:30.977880 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:30.993140 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f0577-899f-4d86-84f5-694d3c2e57da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:30.994101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f0577-899f-4d86-84f5-694d3c2e57da None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:30.994570 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f0577-899f-4d86-84f5-694d3c2e57da None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:30.995096 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f0577-899f-4d86-84f5-694d3c2e57da None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:30.995954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f0577-899f-4d86-84f5-694d3c2e57da None admin] RBAC: Adding query filter params (name=reader) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:30.996444 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f0577-899f-4d86-84f5-694d3c2e57da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:30.998018 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f0577-899f-4d86-84f5-694d3c2e57da None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:31.014048 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 73/147] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:03:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:31.019991 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55486f0-6999-45ea-83bd-8c472810f156 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:31.104470 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:31.153980 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55486f0-6999-45ea-83bd-8c472810f156 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:31.198309 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f7a09-e488-42b9-9505-c94ee959e4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:31.198907 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f7a09-e488-42b9-9505-c94ee959e4cd None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:31.199187 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f7a09-e488-42b9-9505-c94ee959e4cd None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:31.199460 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f7a09-e488-42b9-9505-c94ee959e4cd None admin] PATH_INFO: `/v3/users/389e2146b19b409ca436c670559712c0` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:31.200629 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f7a09-e488-42b9-9505-c94ee959e4cd None admin] RBAC: Authorizing `identity:get_user(user_id=389e2146b19b409ca436c670559712c0)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:31.202089 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f7a09-e488-42b9-9505-c94ee959e4cd None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:31.204026 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 75/148] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:31 2022] GET /identity/v3/users/389e2146b19b409ca436c670559712c0 => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:31.209845 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f0577-899f-4d86-84f5-694d3c2e57da None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:31.351804 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f0577-899f-4d86-84f5-694d3c2e57da None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:31.389541 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83067621-06cc-4ce8-a2c7-ba0b8dcefcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:31.390551 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83067621-06cc-4ce8-a2c7-ba0b8dcefcb6 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:31.391048 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83067621-06cc-4ce8-a2c7-ba0b8dcefcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:31.391529 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83067621-06cc-4ce8-a2c7-ba0b8dcefcb6 None admin] PATH_INFO: `/v3/projects/b8c35869b0184f978d0e9bb42b22ad27` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:31.395822 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83067621-06cc-4ce8-a2c7-ba0b8dcefcb6 None admin] RBAC: Authorizing `identity:get_project(project_id=b8c35869b0184f978d0e9bb42b22ad27)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:31.398111 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83067621-06cc-4ce8-a2c7-ba0b8dcefcb6 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:31.400728 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 74/149] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:31 2022] GET /identity/v3/projects/b8c35869b0184f978d0e9bb42b22ad27 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:31.409168 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f7a09-e488-42b9-9505-c94ee959e4cd None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:31.416968 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83067621-06cc-4ce8-a2c7-ba0b8dcefcb6 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:31.490813 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:31.575066 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83067621-06cc-4ce8-a2c7-ba0b8dcefcb6 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:31.612799 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f7a09-e488-42b9-9505-c94ee959e4cd None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:31.636985 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042f0f6-f32e-49a4-aef3-6fff843247df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:31.637909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042f0f6-f32e-49a4-aef3-6fff843247df None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:31.638190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042f0f6-f32e-49a4-aef3-6fff843247df None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:31.638464 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042f0f6-f32e-49a4-aef3-6fff843247df None admin] PATH_INFO: `/v3/roles/member` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:31.662921 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042f0f6-f32e-49a4-aef3-6fff843247df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:31.669785 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-6042f0f6-f32e-49a4-aef3-6fff843247df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:03:31.669785 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:31.669785 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:31.669785 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:31.669785 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:31.669785 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:31.669785 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:31.669785 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:31.669785 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:31.669785 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:31.669785 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:31.669785 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:31.669785 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:31.669785 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:31.669785 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:31.669785 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:31.670784 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:31.670784 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:31.670784 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:31.670784 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:31.670784 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:31.670784 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:31.670784 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:31.670784 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:31.670784 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:31.670784 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:31.670784 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:31.670784 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:31.670784 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:31.670784 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:31.670784 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:31.670784 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:31.671542 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:31.671542 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:31.671542 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:31.671542 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:31.671542 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:31.671542 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:31.671542 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:31.671542 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:31.671542 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:31.671542 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:31.671542 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:03:31.671542 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:03:31.674160 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:31.676068 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 75/150] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:31.685162 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042f0f6-f32e-49a4-aef3-6fff843247df None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:31.707383 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3f800-8b76-44a3-839a-4de69a010324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:31.708222 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3f800-8b76-44a3-839a-4de69a010324 None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:31.708606 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3f800-8b76-44a3-839a-4de69a010324 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:31.708890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3f800-8b76-44a3-839a-4de69a010324 None admin] PATH_INFO: `/v3/projects/b8c35869b0184f978d0e9bb42b22ad27/users/389e2146b19b409ca436c670559712c0/roles/5e1d0d5215694636b5147ed0d216c047` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:31.715592 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3f800-8b76-44a3-839a-4de69a010324 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8c35869b0184f978d0e9bb42b22ad27, user_id=389e2146b19b409ca436c670559712c0, role_id=5e1d0d5215694636b5147ed0d216c047)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:31.717495 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3f800-8b76-44a3-839a-4de69a010324 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:31.742168 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 76/151] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Sep 13 12:03:31 2022] PUT /identity/v3/projects/b8c35869b0184f978d0e9bb42b22ad27/users/389e2146b19b409ca436c670559712c0/roles/5e1d0d5215694636b5147ed0d216c047 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:03:31.743437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e84ed-492a-41ed-a788-6d70c54398a2 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:31.743723 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e84ed-492a-41ed-a788-6d70c54398a2 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:31.744001 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e84ed-492a-41ed-a788-6d70c54398a2 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:31.750227 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 77/152] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:31.751665 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e6676-5904-4ac9-a686-288663dc43b3 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:31.751946 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e6676-5904-4ac9-a686-288663dc43b3 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:31.752219 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e6676-5904-4ac9-a686-288663dc43b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:31.787647 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-a11e6676-5904-4ac9-a686-288663dc43b3 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:31.788873 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-a11e6676-5904-4ac9-a686-288663dc43b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:31.893063 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042f0f6-f32e-49a4-aef3-6fff843247df None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:31.940567 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:31.952820 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 78/153] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:31.963234 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f416b-90a4-40f4-9afd-c854d6ac9f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:31.963955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f416b-90a4-40f4-9afd-c854d6ac9f1d None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:31.964421 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f416b-90a4-40f4-9afd-c854d6ac9f1d None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:31.964704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f416b-90a4-40f4-9afd-c854d6ac9f1d None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:31.965391 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f416b-90a4-40f4-9afd-c854d6ac9f1d None admin] RBAC: Adding query filter params (name=member) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:31.965701 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f416b-90a4-40f4-9afd-c854d6ac9f1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:31.967440 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f416b-90a4-40f4-9afd-c854d6ac9f1d None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:31.979776 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 76/154] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:03:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:31.985768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e6676-5904-4ac9-a686-288663dc43b3 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:32.124686 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e6676-5904-4ac9-a686-288663dc43b3 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:32.150006 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:32.171380 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2550f99-a31f-4419-a85c-fe5f6e6d79c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:32.172022 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2550f99-a31f-4419-a85c-fe5f6e6d79c0 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:32.172300 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2550f99-a31f-4419-a85c-fe5f6e6d79c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:32.172572 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2550f99-a31f-4419-a85c-fe5f6e6d79c0 None admin] PATH_INFO: `/v3/users/202e3f4635df4dfca22906fc29c21b69` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:32.173712 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2550f99-a31f-4419-a85c-fe5f6e6d79c0 None admin] RBAC: Authorizing `identity:get_user(user_id=202e3f4635df4dfca22906fc29c21b69)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:32.175174 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2550f99-a31f-4419-a85c-fe5f6e6d79c0 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:32.177303 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 79/155] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:31 2022] GET /identity/v3/users/202e3f4635df4dfca22906fc29c21b69 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:32.183392 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f416b-90a4-40f4-9afd-c854d6ac9f1d None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:32.333802 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f416b-90a4-40f4-9afd-c854d6ac9f1d None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:32.370252 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03e364-b19f-46c5-99d4-e9e7bf9dede2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:32.370954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03e364-b19f-46c5-99d4-e9e7bf9dede2 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:32.371167 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03e364-b19f-46c5-99d4-e9e7bf9dede2 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:32.371437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03e364-b19f-46c5-99d4-e9e7bf9dede2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:32.440524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:32.462595 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03e364-b19f-46c5-99d4-e9e7bf9dede2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:32.464111 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb03e364-b19f-46c5-99d4-e9e7bf9dede2 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:32.598135 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 77/156] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:03:32.603923 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2550f99-a31f-4419-a85c-fe5f6e6d79c0 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:32.728401 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2550f99-a31f-4419-a85c-fe5f6e6d79c0 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:32.769729 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd69fa6-7c5c-40a5-aa3b-b75948058db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:32.770372 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd69fa6-7c5c-40a5-aa3b-b75948058db1 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:32.770667 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd69fa6-7c5c-40a5-aa3b-b75948058db1 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:32.770941 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd69fa6-7c5c-40a5-aa3b-b75948058db1 None admin] PATH_INFO: `/v3/projects/b8c35869b0184f978d0e9bb42b22ad27` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:32.775315 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd69fa6-7c5c-40a5-aa3b-b75948058db1 None admin] RBAC: Authorizing `identity:get_project(project_id=b8c35869b0184f978d0e9bb42b22ad27)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:32.776783 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd69fa6-7c5c-40a5-aa3b-b75948058db1 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:32.778445 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 80/157] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:32 2022] GET /identity/v3/projects/b8c35869b0184f978d0e9bb42b22ad27 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:32.784854 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03e364-b19f-46c5-99d4-e9e7bf9dede2 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:32.875343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:32.889457 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd69fa6-7c5c-40a5-aa3b-b75948058db1 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:32.919456 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb03e364-b19f-46c5-99d4-e9e7bf9dede2 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:32.999212 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:33.011750 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7fdfe-ba00-44c8-9b5e-82faae41318c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:33.012790 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7fdfe-ba00-44c8-9b5e-82faae41318c None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:33.013286 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7fdfe-ba00-44c8-9b5e-82faae41318c None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:33.013786 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7fdfe-ba00-44c8-9b5e-82faae41318c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:33.015213 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7fdfe-ba00-44c8-9b5e-82faae41318c None admin] RBAC: Adding query filter params (role.id=ab14a68bf5b54561badd35b83e6acaf5, scope.project.id=b8c35869b0184f978d0e9bb42b22ad27, user.id=202e3f4635df4dfca22906fc29c21b69) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:33.015748 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7fdfe-ba00-44c8-9b5e-82faae41318c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:33.018632 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7fdfe-ba00-44c8-9b5e-82faae41318c None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:33.034717 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 78/158] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:32 2022] GET /identity/v3/role_assignments?user.id=202e3f4635df4dfca22906fc29c21b69&scope.project.id=b8c35869b0184f978d0e9bb42b22ad27&role.id=ab14a68bf5b54561badd35b83e6acaf5 => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:33.081278 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b9de0-8e9e-4d4e-834e-e7cd2f25bae1 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:33.082283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b9de0-8e9e-4d4e-834e-e7cd2f25bae1 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:33.082574 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b9de0-8e9e-4d4e-834e-e7cd2f25bae1 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:33.085134 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 79/159] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:33.096189 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd69fa6-7c5c-40a5-aa3b-b75948058db1 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:33.108032 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6fdcf-a11d-4e0e-93d3-790d44827139 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:33.108525 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6fdcf-a11d-4e0e-93d3-790d44827139 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:33.108990 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6fdcf-a11d-4e0e-93d3-790d44827139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:33.160428 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-7ff6fdcf-a11d-4e0e-93d3-790d44827139 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:33.161067 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953ff04-c210-4424-b154-7a5327af5d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:33.161981 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953ff04-c210-4424-b154-7a5327af5d02 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:33.162464 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953ff04-c210-4424-b154-7a5327af5d02 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:33.162693 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-7ff6fdcf-a11d-4e0e-93d3-790d44827139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:33.163152 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953ff04-c210-4424-b154-7a5327af5d02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:33.195664 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953ff04-c210-4424-b154-7a5327af5d02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:33.201634 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-a953ff04-c210-4424-b154-7a5327af5d02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:33.201634 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:33.201634 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:33.201634 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:33.201634 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:33.201634 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:33.201634 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:33.201634 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:33.201634 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:33.201634 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:33.201634 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:33.201634 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:33.201634 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:33.201634 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:33.201634 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:33.201634 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:33.202509 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:33.202509 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:33.202509 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:33.202509 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:33.202509 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:33.202509 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:33.202509 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:33.202509 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:33.202509 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:33.202509 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:33.202509 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:33.202509 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:33.202509 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:33.202509 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:33.202509 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:33.202509 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:33.208559 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:33.208559 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:33.208559 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:33.208559 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:33.208559 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:33.208559 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:33.208559 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:33.208559 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:33.208559 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:33.208559 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:33.208559 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:33.208559 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:03:33.211217 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 81/160] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Sep 13 12:03:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:33.217581 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953ff04-c210-4424-b154-7a5327af5d02 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:33.330263 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 80/161] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:33.382022 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953ff04-c210-4424-b154-7a5327af5d02 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:33.411786 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:33.431665 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bedd8-bade-41f4-8508-9b2169128610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:33.432284 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bedd8-bade-41f4-8508-9b2169128610 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:33.432564 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bedd8-bade-41f4-8508-9b2169128610 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:33.432996 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bedd8-bade-41f4-8508-9b2169128610 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:33.433674 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bedd8-bade-41f4-8508-9b2169128610 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:33.433982 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bedd8-bade-41f4-8508-9b2169128610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:33.435406 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bedd8-bade-41f4-8508-9b2169128610 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:33.458718 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 82/162] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:33.465029 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6fdcf-a11d-4e0e-93d3-790d44827139 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:33.650768 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:33.704988 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6fdcf-a11d-4e0e-93d3-790d44827139 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:33.777617 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151edadd-f527-4f32-a692-21035ba6bbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:33.778582 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151edadd-f527-4f32-a692-21035ba6bbec None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:33.779038 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151edadd-f527-4f32-a692-21035ba6bbec None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:33.779454 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151edadd-f527-4f32-a692-21035ba6bbec None admin] PATH_INFO: `/v3/users/e8c852aa86d546e6891e0dac7b3ec7f8` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:33.783707 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151edadd-f527-4f32-a692-21035ba6bbec None admin] RBAC: Authorizing `identity:get_user(user_id=e8c852aa86d546e6891e0dac7b3ec7f8)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:33.786220 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151edadd-f527-4f32-a692-21035ba6bbec None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:33.789070 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 81/163] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:33 2022] GET /identity/v3/users/e8c852aa86d546e6891e0dac7b3ec7f8 => generated 247 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:33.795271 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bedd8-bade-41f4-8508-9b2169128610 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:33.935263 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bedd8-bade-41f4-8508-9b2169128610 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:33.976466 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51afd8e-8861-4a97-aed2-2f29abaf336f None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:33.976680 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58a964-af35-43a6-9f59-ca91e7888cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:33.976920 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51afd8e-8861-4a97-aed2-2f29abaf336f None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:33.977170 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58a964-af35-43a6-9f59-ca91e7888cf5 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:33.977369 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51afd8e-8861-4a97-aed2-2f29abaf336f None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:33.977472 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58a964-af35-43a6-9f59-ca91e7888cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:33.977708 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58a964-af35-43a6-9f59-ca91e7888cf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:33.980412 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 82/164] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:33.989250 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222c475-dc50-4093-badd-83875532c6df None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:33.989675 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222c475-dc50-4093-badd-83875532c6df None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:33.990111 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222c475-dc50-4093-badd-83875532c6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:34.036945 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-c222c475-dc50-4093-badd-83875532c6df None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:34.038732 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-c222c475-dc50-4093-badd-83875532c6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:34.045419 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:34.066570 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58a964-af35-43a6-9f59-ca91e7888cf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:34.068558 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58a964-af35-43a6-9f59-ca91e7888cf5 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:34.201063 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 83/165] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:03:34.207565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58a964-af35-43a6-9f59-ca91e7888cf5 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:34.216989 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 83/166] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:34.304871 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:34.333652 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58a964-af35-43a6-9f59-ca91e7888cf5 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:34.370904 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021acad-b5dd-4fd3-ac8e-97045fb23e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:34.371578 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021acad-b5dd-4fd3-ac8e-97045fb23e6c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:34.371865 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021acad-b5dd-4fd3-ac8e-97045fb23e6c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:34.372200 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021acad-b5dd-4fd3-ac8e-97045fb23e6c None admin] PATH_INFO: `/v3/projects/b8c35869b0184f978d0e9bb42b22ad27` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:34.376060 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021acad-b5dd-4fd3-ac8e-97045fb23e6c None admin] RBAC: Authorizing `identity:get_project(project_id=b8c35869b0184f978d0e9bb42b22ad27)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:34.377551 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021acad-b5dd-4fd3-ac8e-97045fb23e6c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:34.380048 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 84/167] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:34 2022] GET /identity/v3/projects/b8c35869b0184f978d0e9bb42b22ad27 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:34.387126 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222c475-dc50-4093-badd-83875532c6df None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:34.417739 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021acad-b5dd-4fd3-ac8e-97045fb23e6c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:34.521759 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:34.548436 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021acad-b5dd-4fd3-ac8e-97045fb23e6c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:34.586707 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339b6d4-1296-4498-9f4e-1b644d54864d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:34.587826 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339b6d4-1296-4498-9f4e-1b644d54864d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:34.588300 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339b6d4-1296-4498-9f4e-1b644d54864d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:34.588764 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339b6d4-1296-4498-9f4e-1b644d54864d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:34.603050 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339b6d4-1296-4498-9f4e-1b644d54864d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:34.609097 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-2339b6d4-1296-4498-9f4e-1b644d54864d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:03:34.609097 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:34.609097 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:34.609097 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:34.609097 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:34.609097 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:34.609097 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:34.609097 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:34.609097 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:34.609097 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:34.609097 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:34.609097 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:34.609097 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:34.609097 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:34.609097 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:34.609097 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:34.610166 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:34.610166 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:34.610166 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:34.610166 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:34.610166 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:34.610166 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:34.610166 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:34.610166 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:34.610166 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:34.610166 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:34.610166 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:34.610166 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:34.610166 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:34.610166 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:34.610166 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:34.610166 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:34.610979 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:34.610979 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:34.610979 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:34.610979 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:34.610979 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:34.610979 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:34.610979 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:34.610979 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:34.610979 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:34.610979 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:34.610979 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:03:34.610979 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:03:34.613641 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 85/168] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Sep 13 12:03:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:34.617982 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222c475-dc50-4093-badd-83875532c6df None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:34.621495 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339b6d4-1296-4498-9f4e-1b644d54864d None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:34.626639 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:34.732766 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef055cf3-1ec5-4226-9728-d48a0c7bd41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:34.733312 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef055cf3-1ec5-4226-9728-d48a0c7bd41a None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:34.733424 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef055cf3-1ec5-4226-9728-d48a0c7bd41a None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:34.733658 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef055cf3-1ec5-4226-9728-d48a0c7bd41a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:34.734382 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef055cf3-1ec5-4226-9728-d48a0c7bd41a None admin] RBAC: Adding query filter params (role.id=5609ac7373ba400593bba6d811e3aa72, scope.project.id=b8c35869b0184f978d0e9bb42b22ad27, user.id=e8c852aa86d546e6891e0dac7b3ec7f8) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:34.734718 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef055cf3-1ec5-4226-9728-d48a0c7bd41a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:34.736241 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef055cf3-1ec5-4226-9728-d48a0c7bd41a None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:34.750217 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339b6d4-1296-4498-9f4e-1b644d54864d None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:34.752908 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 84/169] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:34 2022] GET /identity/v3/role_assignments?user.id=e8c852aa86d546e6891e0dac7b3ec7f8&scope.project.id=b8c35869b0184f978d0e9bb42b22ad27&role.id=5609ac7373ba400593bba6d811e3aa72 => generated 608 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:34.806003 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4722c25-7a67-45cb-8d22-a66191b8905c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:34.807372 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4722c25-7a67-45cb-8d22-a66191b8905c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:34.807658 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4722c25-7a67-45cb-8d22-a66191b8905c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:34.807932 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4722c25-7a67-45cb-8d22-a66191b8905c None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:34.808619 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4722c25-7a67-45cb-8d22-a66191b8905c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:34.809044 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4722c25-7a67-45cb-8d22-a66191b8905c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:34.810331 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4722c25-7a67-45cb-8d22-a66191b8905c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:34.829047 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 86/170] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:34.835474 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef055cf3-1ec5-4226-9728-d48a0c7bd41a None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:34.885299 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4722c25-7a67-45cb-8d22-a66191b8905c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:35.028561 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef055cf3-1ec5-4226-9728-d48a0c7bd41a None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:35.050958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:35.086832 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97a9d3-5208-45b8-933c-5f0f09f6f52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:35.087392 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97a9d3-5208-45b8-933c-5f0f09f6f52b None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:35.087667 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97a9d3-5208-45b8-933c-5f0f09f6f52b None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:35.087939 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97a9d3-5208-45b8-933c-5f0f09f6f52b None admin] PATH_INFO: `/v3/users/202e3f4635df4dfca22906fc29c21b69` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:35.089150 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97a9d3-5208-45b8-933c-5f0f09f6f52b None admin] RBAC: Authorizing `identity:get_user(user_id=202e3f4635df4dfca22906fc29c21b69)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:35.094840 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97a9d3-5208-45b8-933c-5f0f09f6f52b None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:35.096610 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 85/171] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:34 2022] GET /identity/v3/users/202e3f4635df4dfca22906fc29c21b69 => generated 275 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:35.102824 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97a9d3-5208-45b8-933c-5f0f09f6f52b None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:35.114395 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:35.152334 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4722c25-7a67-45cb-8d22-a66191b8905c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:35.232380 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abde87-e34a-40cd-b98f-229de214cb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:35.233028 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abde87-e34a-40cd-b98f-229de214cb15 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:35.233303 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abde87-e34a-40cd-b98f-229de214cb15 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:35.233582 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abde87-e34a-40cd-b98f-229de214cb15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:35.257400 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abde87-e34a-40cd-b98f-229de214cb15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:35.262870 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-d4abde87-e34a-40cd-b98f-229de214cb15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:03:35.262870 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:35.262870 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:35.262870 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:35.262870 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:35.262870 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:35.262870 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:35.262870 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:35.262870 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:35.262870 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:35.262870 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:35.262870 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:35.262870 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:35.262870 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:35.262870 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:35.262870 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:35.263762 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:35.263762 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:35.263762 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:35.263762 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:35.263762 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:35.263762 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:35.263762 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:35.263762 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:35.263762 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:35.263762 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:35.263762 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:35.263762 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:35.263762 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:35.263762 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:35.263762 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:35.263762 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:35.264581 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:35.264581 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:35.264581 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:35.264581 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:35.264581 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:35.264581 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:35.264581 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:35.264581 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:35.264581 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:35.264581 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:35.264581 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:03:35.264581 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:03:35.266991 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 87/172] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:35.271485 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abde87-e34a-40cd-b98f-229de214cb15 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:35.342676 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97a9d3-5208-45b8-933c-5f0f09f6f52b None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:35.415629 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b72bf0-14ba-4187-9666-f205b906918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:35.416263 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b72bf0-14ba-4187-9666-f205b906918b None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:35.416550 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b72bf0-14ba-4187-9666-f205b906918b None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:35.416829 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b72bf0-14ba-4187-9666-f205b906918b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:35.484663 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abde87-e34a-40cd-b98f-229de214cb15 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:35.536284 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:35.537808 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b72bf0-14ba-4187-9666-f205b906918b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:35.539343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b72bf0-14ba-4187-9666-f205b906918b None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:35.548111 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:35.562275 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470bb54-8230-4fc8-8e72-75b23cd0e1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:35.562922 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470bb54-8230-4fc8-8e72-75b23cd0e1ac None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:35.563188 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470bb54-8230-4fc8-8e72-75b23cd0e1ac None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:35.563582 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470bb54-8230-4fc8-8e72-75b23cd0e1ac None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:35.564509 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d470bb54-8230-4fc8-8e72-75b23cd0e1ac None admin] RBAC: Adding query filter params (name=member) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:35.564813 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d470bb54-8230-4fc8-8e72-75b23cd0e1ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:35.567179 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d470bb54-8230-4fc8-8e72-75b23cd0e1ac None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:35.584143 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 88/173] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:03:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:35.589815 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470bb54-8230-4fc8-8e72-75b23cd0e1ac None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:35.751090 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 86/174] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:03:35.752234 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dac8eb-c8f3-4bc7-9113-624f67f5811c None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:35.752520 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dac8eb-c8f3-4bc7-9113-624f67f5811c None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:35.752880 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dac8eb-c8f3-4bc7-9113-624f67f5811c None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:35.754665 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 87/175] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:35.759675 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dac8eb-c8f3-4bc7-9113-624f67f5811c None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:35.763023 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470bb54-8230-4fc8-8e72-75b23cd0e1ac None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:35.816327 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a8047-3d05-4583-b7c9-025eb913ed30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:35.817223 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a8047-3d05-4583-b7c9-025eb913ed30 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:35.817503 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a8047-3d05-4583-b7c9-025eb913ed30 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:35.817778 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a8047-3d05-4583-b7c9-025eb913ed30 None admin] PATH_INFO: `/v3/users/202e3f4635df4dfca22906fc29c21b69` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:35.819057 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a8047-3d05-4583-b7c9-025eb913ed30 None admin] RBAC: Authorizing `identity:get_user(user_id=202e3f4635df4dfca22906fc29c21b69)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:35.820637 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a8047-3d05-4583-b7c9-025eb913ed30 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:35.822363 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 89/176] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:35 2022] GET /identity/v3/users/202e3f4635df4dfca22906fc29c21b69 => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:35.823884 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4459a-cec0-4ba9-8d75-a20c8a9d850a None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:35.824198 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4459a-cec0-4ba9-8d75-a20c8a9d850a None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:35.824471 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4459a-cec0-4ba9-8d75-a20c8a9d850a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:35.848743 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-75d4459a-cec0-4ba9-8d75-a20c8a9d850a None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:35.850153 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-75d4459a-cec0-4ba9-8d75-a20c8a9d850a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:35.923665 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:35.939589 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dac8eb-c8f3-4bc7-9113-624f67f5811c None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:35.942337 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:35.954421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 90/177] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:35.955754 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4459a-cec0-4ba9-8d75-a20c8a9d850a None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:36.000390 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5b004-2a0f-432b-abcd-02537437dbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:36.001044 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5b004-2a0f-432b-abcd-02537437dbb5 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:36.001370 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5b004-2a0f-432b-abcd-02537437dbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:36.001602 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5b004-2a0f-432b-abcd-02537437dbb5 None admin] PATH_INFO: `/v3/projects/b8c35869b0184f978d0e9bb42b22ad27` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:36.007474 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5b004-2a0f-432b-abcd-02537437dbb5 None admin] RBAC: Authorizing `identity:get_project(project_id=b8c35869b0184f978d0e9bb42b22ad27)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:36.008973 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5b004-2a0f-432b-abcd-02537437dbb5 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:36.010726 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 88/178] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:35 2022] GET /identity/v3/projects/b8c35869b0184f978d0e9bb42b22ad27 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:36.016645 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5b004-2a0f-432b-abcd-02537437dbb5 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:36.102520 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4459a-cec0-4ba9-8d75-a20c8a9d850a None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:36.155654 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ee1d2-f3d1-4941-b6ab-423fd73de6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:36.156650 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ee1d2-f3d1-4941-b6ab-423fd73de6a1 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:36.157123 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ee1d2-f3d1-4941-b6ab-423fd73de6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:36.157584 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ee1d2-f3d1-4941-b6ab-423fd73de6a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:36.233227 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:36.253053 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ee1d2-f3d1-4941-b6ab-423fd73de6a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:36.256306 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ee1d2-f3d1-4941-b6ab-423fd73de6a1 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:36.265002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5b004-2a0f-432b-abcd-02537437dbb5 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:36.362129 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416900d-d612-4389-8167-66c8c668c01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:36.362852 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416900d-d612-4389-8167-66c8c668c01f None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:36.363197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416900d-d612-4389-8167-66c8c668c01f None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:36.363476 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416900d-d612-4389-8167-66c8c668c01f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:36.364216 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416900d-d612-4389-8167-66c8c668c01f None admin] RBAC: Adding query filter params (role.id=f396be01985a422c96d757a4c77a1fb1, scope.project.id=b8c35869b0184f978d0e9bb42b22ad27, user.id=202e3f4635df4dfca22906fc29c21b69) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:36.364524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416900d-d612-4389-8167-66c8c668c01f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:36.365980 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416900d-d612-4389-8167-66c8c668c01f None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:36.382300 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 89/179] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:36 2022] GET /identity/v3/role_assignments?user.id=202e3f4635df4dfca22906fc29c21b69&scope.project.id=b8c35869b0184f978d0e9bb42b22ad27&role.id=f396be01985a422c96d757a4c77a1fb1 => generated 608 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:36.383680 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf14de-ac98-47a8-990a-a1e2a15e2e4c None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:36.383974 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf14de-ac98-47a8-990a-a1e2a15e2e4c None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:36.384249 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf14de-ac98-47a8-990a-a1e2a15e2e4c None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:36.385493 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 90/180] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:36.397286 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16f50a-298f-4580-a97d-10888f8867b5 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:36.397584 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16f50a-298f-4580-a97d-10888f8867b5 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:36.397820 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16f50a-298f-4580-a97d-10888f8867b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:36.407412 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 91/181] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:03:36.415995 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ee1d2-f3d1-4941-b6ab-423fd73de6a1 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:36.436547 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-fb16f50a-298f-4580-a97d-10888f8867b5 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:36.442705 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-fb16f50a-298f-4580-a97d-10888f8867b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:36.524625 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:36.600434 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:36.621149 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ee1d2-f3d1-4941-b6ab-423fd73de6a1 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:36.647256 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 91/182] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:03:36.648242 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16f50a-298f-4580-a97d-10888f8867b5 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:36.725965 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25511e5-c13c-44e3-b100-a1f8ce4ebd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:36.726645 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25511e5-c13c-44e3-b100-a1f8ce4ebd31 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:36.726924 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25511e5-c13c-44e3-b100-a1f8ce4ebd31 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:36.727200 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25511e5-c13c-44e3-b100-a1f8ce4ebd31 None admin] PATH_INFO: `/v3/projects/c2661b95d4da4aedb93aaa77559c83c3` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:36.731312 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25511e5-c13c-44e3-b100-a1f8ce4ebd31 None admin] RBAC: Authorizing `identity:get_project(project_id=c2661b95d4da4aedb93aaa77559c83c3)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:36.732787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25511e5-c13c-44e3-b100-a1f8ce4ebd31 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:36.736126 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 92/183] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:36 2022] GET /identity/v3/projects/c2661b95d4da4aedb93aaa77559c83c3 => generated 312 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:36.743614 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25511e5-c13c-44e3-b100-a1f8ce4ebd31 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:36.881825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16f50a-298f-4580-a97d-10888f8867b5 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:36.921127 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26913844-5e81-417e-b627-ec4d4dfc8235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:36.921772 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26913844-5e81-417e-b627-ec4d4dfc8235 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:36.922054 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26913844-5e81-417e-b627-ec4d4dfc8235 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:36.922328 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26913844-5e81-417e-b627-ec4d4dfc8235 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:36.933909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26913844-5e81-417e-b627-ec4d4dfc8235 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:36.939028 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-26913844-5e81-417e-b627-ec4d4dfc8235 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:36.939028 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:36.939028 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:36.939028 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:36.939028 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:36.939028 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:36.939028 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:36.939028 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:36.939028 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:36.939028 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:36.939028 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:36.939028 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:36.939028 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:36.939028 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:36.939028 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:36.939028 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:36.939933 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:36.939933 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:36.939933 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:36.939933 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:36.939933 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:36.939933 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:36.939933 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:36.939933 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:36.939933 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:36.939933 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:36.939933 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:36.939933 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:36.939933 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:36.939933 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:36.939933 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:36.939933 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:36.940791 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:36.940791 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:36.940791 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:36.940791 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:36.940791 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:36.940791 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:36.940791 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:36.940791 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:36.940791 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:36.940791 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:36.940791 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:36.940791 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:03:36.940791 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 92/184] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Sep 13 12:03:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:36.941439 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9ae93-0c5a-442f-a922-6cf453549a19 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:36.942237 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9ae93-0c5a-442f-a922-6cf453549a19 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:36.942418 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9ae93-0c5a-442f-a922-6cf453549a19 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:36.948082 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 93/185] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:36.949606 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9ae93-0c5a-442f-a922-6cf453549a19 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:36.952465 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25511e5-c13c-44e3-b100-a1f8ce4ebd31 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:36.991010 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:37.033149 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8f50f-a41e-4637-b729-7bc955db5e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:37.033772 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8f50f-a41e-4637-b729-7bc955db5e68 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:37.034051 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8f50f-a41e-4637-b729-7bc955db5e68 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:37.034322 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8f50f-a41e-4637-b729-7bc955db5e68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:37.035961 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8f50f-a41e-4637-b729-7bc955db5e68 None admin] RBAC: Adding query filter params (role.id=ab14a68bf5b54561badd35b83e6acaf5, scope.project.id=c2661b95d4da4aedb93aaa77559c83c3, user.id=202e3f4635df4dfca22906fc29c21b69) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:37.036309 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8f50f-a41e-4637-b729-7bc955db5e68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:37.037814 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8f50f-a41e-4637-b729-7bc955db5e68 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:37.048221 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 93/186] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:36 2022] GET /identity/v3/role_assignments?user.id=202e3f4635df4dfca22906fc29c21b69&scope.project.id=c2661b95d4da4aedb93aaa77559c83c3&role.id=ab14a68bf5b54561badd35b83e6acaf5 => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:37.052308 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824355f-7f73-40a8-af4d-7aa07271462d None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:37.052822 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824355f-7f73-40a8-af4d-7aa07271462d None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:37.053420 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824355f-7f73-40a8-af4d-7aa07271462d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:37.088169 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-b824355f-7f73-40a8-af4d-7aa07271462d None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:37.088505 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9ae93-0c5a-442f-a922-6cf453549a19 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:37.090278 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-b824355f-7f73-40a8-af4d-7aa07271462d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:37.124156 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:37.157836 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eff1ca-8c76-4c97-8498-374d40ab5429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:37.159309 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eff1ca-8c76-4c97-8498-374d40ab5429 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:37.160989 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eff1ca-8c76-4c97-8498-374d40ab5429 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:37.161638 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eff1ca-8c76-4c97-8498-374d40ab5429 None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:37.163110 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eff1ca-8c76-4c97-8498-374d40ab5429 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:37.163846 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eff1ca-8c76-4c97-8498-374d40ab5429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:37.166869 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eff1ca-8c76-4c97-8498-374d40ab5429 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:37.184663 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 94/187] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:37.195182 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d08678-5540-4204-bcd7-ae918f310790 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:37.195922 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d08678-5540-4204-bcd7-ae918f310790 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:37.196687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d08678-5540-4204-bcd7-ae918f310790 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:37.202272 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 95/188] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:37 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:37.204148 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d08678-5540-4204-bcd7-ae918f310790 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:37.242878 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 94/189] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:37.244674 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fea75-4e3d-4ded-bd8c-3138a8364bf4 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:37.245094 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fea75-4e3d-4ded-bd8c-3138a8364bf4 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:37.245514 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fea75-4e3d-4ded-bd8c-3138a8364bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:37.276492 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-b89fea75-4e3d-4ded-bd8c-3138a8364bf4 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:37.277714 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-b89fea75-4e3d-4ded-bd8c-3138a8364bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:37.356655 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:37.377827 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d08678-5540-4204-bcd7-ae918f310790 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:37.387395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 95/190] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:37.392848 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fea75-4e3d-4ded-bd8c-3138a8364bf4 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:37.416352 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b97ec-e9c1-4e91-8eb2-45c187cc456e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:37.416891 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b97ec-e9c1-4e91-8eb2-45c187cc456e None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:37.417172 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b97ec-e9c1-4e91-8eb2-45c187cc456e None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:37.417447 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b97ec-e9c1-4e91-8eb2-45c187cc456e None admin] PATH_INFO: `/v3/users/e5a369d7664943c58f1d09acd6842c5e` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:37.433633 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b97ec-e9c1-4e91-8eb2-45c187cc456e None admin] RBAC: Authorizing `identity:get_user(user_id=e5a369d7664943c58f1d09acd6842c5e)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:37.435839 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b97ec-e9c1-4e91-8eb2-45c187cc456e None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:37.438929 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 96/191] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:37 2022] GET /identity/v3/users/e5a369d7664943c58f1d09acd6842c5e => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:37.448827 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b97ec-e9c1-4e91-8eb2-45c187cc456e None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:37.497004 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:37.523698 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fea75-4e3d-4ded-bd8c-3138a8364bf4 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:37.566204 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea11fa-2e1a-4e56-9a95-d327514b8e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:37.566905 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea11fa-2e1a-4e56-9a95-d327514b8e64 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:37.567177 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea11fa-2e1a-4e56-9a95-d327514b8e64 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:37.567496 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea11fa-2e1a-4e56-9a95-d327514b8e64 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:37.579760 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea11fa-2e1a-4e56-9a95-d327514b8e64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:37.586120 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-f8ea11fa-2e1a-4e56-9a95-d327514b8e64 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:03:37.586120 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:37.586120 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:37.586120 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:37.586120 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:37.586120 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:37.586120 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:37.586120 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:37.586120 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:37.586120 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:37.586120 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:37.586120 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:37.586120 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:37.586120 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:37.586120 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:37.586120 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:37.587788 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:37.587788 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:37.587788 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:37.587788 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:37.587788 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:37.587788 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:37.587788 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:37.587788 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:37.587788 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:37.587788 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:37.587788 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:37.587788 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:37.587788 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:37.587788 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:37.587788 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:37.587788 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:37.589301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:37.589301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:37.589301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:37.589301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:37.589301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:37.589301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:37.589301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:37.589301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:37.589301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:37.589301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:37.589301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:03:37.589301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:03:37.589301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 96/192] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:37.599159 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea11fa-2e1a-4e56-9a95-d327514b8e64 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:37.637726 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b97ec-e9c1-4e91-8eb2-45c187cc456e None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:37.691799 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51e301-2fba-43ac-9234-7d910fff3fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:37.692405 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51e301-2fba-43ac-9234-7d910fff3fdb None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:37.692682 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51e301-2fba-43ac-9234-7d910fff3fdb None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:37.692954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51e301-2fba-43ac-9234-7d910fff3fdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:37.710405 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:37.728375 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea11fa-2e1a-4e56-9a95-d327514b8e64 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:37.770555 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51e301-2fba-43ac-9234-7d910fff3fdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:37.770816 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f09f62-fe24-46a4-af87-e7c7628297a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:37.771222 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f09f62-fe24-46a4-af87-e7c7628297a6 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:37.771504 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f09f62-fe24-46a4-af87-e7c7628297a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:37.771779 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f09f62-fe24-46a4-af87-e7c7628297a6 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:37.772071 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51e301-2fba-43ac-9234-7d910fff3fdb None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:37.772452 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f09f62-fe24-46a4-af87-e7c7628297a6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:37.772757 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f09f62-fe24-46a4-af87-e7c7628297a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:37.774124 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f09f62-fe24-46a4-af87-e7c7628297a6 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:37.779630 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:37.783682 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 97/193] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:03:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:37.784990 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f09f62-fe24-46a4-af87-e7c7628297a6 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:37.876973 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 97/194] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:03:37.877815 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51e301-2fba-43ac-9234-7d910fff3fdb None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:37.896089 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f09f62-fe24-46a4-af87-e7c7628297a6 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:37.929057 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:37.932365 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6274f-d7ba-465a-b523-29c5937fe0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:37.933012 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6274f-d7ba-465a-b523-29c5937fe0be None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:37.933294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6274f-d7ba-465a-b523-29c5937fe0be None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:37.933563 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6274f-d7ba-465a-b523-29c5937fe0be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:37.944857 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6274f-d7ba-465a-b523-29c5937fe0be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:37.950709 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-71c6274f-d7ba-465a-b523-29c5937fe0be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:03:37.950709 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:37.950709 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:37.950709 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:37.950709 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:37.950709 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:37.950709 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:37.950709 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:37.950709 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:37.950709 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:37.950709 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:37.950709 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:37.950709 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:37.950709 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:37.950709 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:37.950709 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:37.952486 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:37.952486 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:37.952486 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:37.952486 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:37.952486 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:37.952486 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:37.952486 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:37.952486 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:37.952486 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:37.952486 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:37.952486 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:37.952486 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:37.952486 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:37.952486 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:37.952486 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:37.952486 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:37.954759 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:37.954759 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:37.954759 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:37.954759 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:37.954759 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:37.954759 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:37.954759 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:37.954759 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:37.954759 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:37.954759 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:37.954759 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:03:37.954759 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:03:37.954759 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 98/195] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Sep 13 12:03:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:37.954759 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6274f-d7ba-465a-b523-29c5937fe0be None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:37.989896 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51e301-2fba-43ac-9234-7d910fff3fdb None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:38.018699 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:38.025538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10be22d-c6b7-4c5e-8c38-6a2b9f52c3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:38.026163 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10be22d-c6b7-4c5e-8c38-6a2b9f52c3b7 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:38.026442 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10be22d-c6b7-4c5e-8c38-6a2b9f52c3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:38.026754 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10be22d-c6b7-4c5e-8c38-6a2b9f52c3b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:38.027959 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10be22d-c6b7-4c5e-8c38-6a2b9f52c3b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:38.029396 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10be22d-c6b7-4c5e-8c38-6a2b9f52c3b7 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:38.030999 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 98/196] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:38.031755 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10be22d-c6b7-4c5e-8c38-6a2b9f52c3b7 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:38.068740 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6274f-d7ba-465a-b523-29c5937fe0be None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:38.103566 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525933e-a362-4972-aae6-6a31f63fdf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:38.104248 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525933e-a362-4972-aae6-6a31f63fdf3c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:38.104578 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525933e-a362-4972-aae6-6a31f63fdf3c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:38.104901 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525933e-a362-4972-aae6-6a31f63fdf3c None admin] PATH_INFO: `/v3/users/389e2146b19b409ca436c670559712c0` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:38.106113 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525933e-a362-4972-aae6-6a31f63fdf3c None admin] RBAC: Authorizing `identity:get_user(user_id=389e2146b19b409ca436c670559712c0)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:38.107637 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525933e-a362-4972-aae6-6a31f63fdf3c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:38.109221 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 99/197] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:37 2022] GET /identity/v3/users/389e2146b19b409ca436c670559712c0 => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:38.113317 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525933e-a362-4972-aae6-6a31f63fdf3c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:38.147713 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10be22d-c6b7-4c5e-8c38-6a2b9f52c3b7 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:38.167270 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:38.190698 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fcba4-2457-47e0-a9f1-2450d4adb30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:38.192043 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fcba4-2457-47e0-a9f1-2450d4adb30a None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:38.192387 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fcba4-2457-47e0-a9f1-2450d4adb30a None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:38.192644 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fcba4-2457-47e0-a9f1-2450d4adb30a None admin] PATH_INFO: `/v3/projects/85323b48b377409bb1a44ca2c635e0c4` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:38.194240 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fcba4-2457-47e0-a9f1-2450d4adb30a None admin] RBAC: Authorizing `identity:get_project(project_id=85323b48b377409bb1a44ca2c635e0c4)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:38.195286 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fcba4-2457-47e0-a9f1-2450d4adb30a None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:38.196902 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 99/198] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:38 2022] GET /identity/v3/projects/85323b48b377409bb1a44ca2c635e0c4 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:38.197752 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fcba4-2457-47e0-a9f1-2450d4adb30a None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:38.232819 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525933e-a362-4972-aae6-6a31f63fdf3c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:38.262868 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:38.272608 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd422e-8d9f-42a9-af41-56bee388c51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:38.273214 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd422e-8d9f-42a9-af41-56bee388c51d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:38.273492 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd422e-8d9f-42a9-af41-56bee388c51d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:38.273759 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd422e-8d9f-42a9-af41-56bee388c51d None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:38.274424 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd422e-8d9f-42a9-af41-56bee388c51d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:38.274761 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd422e-8d9f-42a9-af41-56bee388c51d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:38.276115 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd422e-8d9f-42a9-af41-56bee388c51d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:38.284731 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 100/199] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:38.285794 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd422e-8d9f-42a9-af41-56bee388c51d None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:38.309435 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fcba4-2457-47e0-a9f1-2450d4adb30a None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:38.345287 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafa695-7dd0-4cf7-8a22-decc85756c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:38.345891 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafa695-7dd0-4cf7-8a22-decc85756c00 None admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:38.346175 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafa695-7dd0-4cf7-8a22-decc85756c00 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:38.346448 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafa695-7dd0-4cf7-8a22-decc85756c00 None admin] PATH_INFO: `/v3/users` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:38.347137 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bafa695-7dd0-4cf7-8a22-decc85756c00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:38.348592 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bafa695-7dd0-4cf7-8a22-decc85756c00 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:38.370889 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 100/200] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Sep 13 12:03:38 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:38.382858 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafa695-7dd0-4cf7-8a22-decc85756c00 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:38.421045 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:38.422945 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd422e-8d9f-42a9-af41-56bee388c51d None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:38.474963 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd063c2d-bf7b-4c7e-8a2a-489d92f3c373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:38.475484 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd063c2d-bf7b-4c7e-8a2a-489d92f3c373 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:38.475766 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd063c2d-bf7b-4c7e-8a2a-489d92f3c373 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:38.476034 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd063c2d-bf7b-4c7e-8a2a-489d92f3c373 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:38.511363 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafa695-7dd0-4cf7-8a22-decc85756c00 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:38.552184 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:38.559841 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7301e-1e0b-4afb-8485-878cdcd753bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:38.561024 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7301e-1e0b-4afb-8485-878cdcd753bc None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:38.561599 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7301e-1e0b-4afb-8485-878cdcd753bc None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:38.562319 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7301e-1e0b-4afb-8485-878cdcd753bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:38.563284 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7301e-1e0b-4afb-8485-878cdcd753bc None admin] RBAC: Adding query filter params (role.id=5609ac7373ba400593bba6d811e3aa72, scope.project.id=85323b48b377409bb1a44ca2c635e0c4, user.id=e5a369d7664943c58f1d09acd6842c5e) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:38.563796 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7301e-1e0b-4afb-8485-878cdcd753bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:38.564846 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd063c2d-bf7b-4c7e-8a2a-489d92f3c373 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:38.565721 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7301e-1e0b-4afb-8485-878cdcd753bc None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:38.566356 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd063c2d-bf7b-4c7e-8a2a-489d92f3c373 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:38.573405 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 101/201] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:38 2022] GET /identity/v3/role_assignments?user.id=e5a369d7664943c58f1d09acd6842c5e&scope.project.id=85323b48b377409bb1a44ca2c635e0c4&role.id=5609ac7373ba400593bba6d811e3aa72 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:38.582694 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7301e-1e0b-4afb-8485-878cdcd753bc None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:38.763383 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 101/202] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:03:38.770631 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd063c2d-bf7b-4c7e-8a2a-489d92f3c373 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:38.771672 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7301e-1e0b-4afb-8485-878cdcd753bc None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:38.774457 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:38.837158 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a457105-e080-418f-b0df-a7de3e440fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:38.838506 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a457105-e080-418f-b0df-a7de3e440fe1 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:38.839520 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a457105-e080-418f-b0df-a7de3e440fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:38.840164 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a457105-e080-418f-b0df-a7de3e440fe1 None admin] PATH_INFO: `/v3/users/e5a369d7664943c58f1d09acd6842c5e` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:38.842096 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a457105-e080-418f-b0df-a7de3e440fe1 None admin] RBAC: Authorizing `identity:get_user(user_id=e5a369d7664943c58f1d09acd6842c5e)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:38.844465 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a457105-e080-418f-b0df-a7de3e440fe1 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:38.845600 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 102/203] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:38 2022] GET /identity/v3/users/e5a369d7664943c58f1d09acd6842c5e => generated 283 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:38.854278 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a457105-e080-418f-b0df-a7de3e440fe1 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:38.963000 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:38.972839 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd063c2d-bf7b-4c7e-8a2a-489d92f3c373 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:39.036012 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68239d7c-a3d0-40fa-a4f9-c681bac826f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:39.037392 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68239d7c-a3d0-40fa-a4f9-c681bac826f0 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:39.037871 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68239d7c-a3d0-40fa-a4f9-c681bac826f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:39.038342 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68239d7c-a3d0-40fa-a4f9-c681bac826f0 None admin] PATH_INFO: `/v3/projects/b8c35869b0184f978d0e9bb42b22ad27` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:39.040819 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68239d7c-a3d0-40fa-a4f9-c681bac826f0 None admin] RBAC: Authorizing `identity:get_project(project_id=b8c35869b0184f978d0e9bb42b22ad27)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:39.043965 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68239d7c-a3d0-40fa-a4f9-c681bac826f0 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:39.044689 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a457105-e080-418f-b0df-a7de3e440fe1 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:39.046415 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 102/204] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:38 2022] GET /identity/v3/projects/b8c35869b0184f978d0e9bb42b22ad27 => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:39.054323 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68239d7c-a3d0-40fa-a4f9-c681bac826f0 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:39.109249 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f917aab-8533-447d-927a-987695f513fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:39.110534 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f917aab-8533-447d-927a-987695f513fb None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:39.111262 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f917aab-8533-447d-927a-987695f513fb None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:39.111984 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f917aab-8533-447d-927a-987695f513fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:39.187126 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:39.270906 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f917aab-8533-447d-927a-987695f513fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:39.272390 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f917aab-8533-447d-927a-987695f513fb None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:39.289488 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68239d7c-a3d0-40fa-a4f9-c681bac826f0 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:39.333288 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2f400-bcb7-44dc-9af9-535d583b5dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:39.334024 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2f400-bcb7-44dc-9af9-535d583b5dbf None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:39.334307 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2f400-bcb7-44dc-9af9-535d583b5dbf None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:39.334582 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2f400-bcb7-44dc-9af9-535d583b5dbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:39.335347 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2f400-bcb7-44dc-9af9-535d583b5dbf None admin] RBAC: Adding query filter params (role.id=5e1d0d5215694636b5147ed0d216c047, scope.project.id=b8c35869b0184f978d0e9bb42b22ad27, user.id=389e2146b19b409ca436c670559712c0) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:39.335656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2f400-bcb7-44dc-9af9-535d583b5dbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:39.337102 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2f400-bcb7-44dc-9af9-535d583b5dbf None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:39.343729 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 103/205] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:39 2022] GET /identity/v3/role_assignments?user.id=389e2146b19b409ca436c670559712c0&scope.project.id=b8c35869b0184f978d0e9bb42b22ad27&role.id=5e1d0d5215694636b5147ed0d216c047 => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:39.495729 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 103/206] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 12:03:39.502803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2f400-bcb7-44dc-9af9-535d583b5dbf None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:39.566810 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:39.684895 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2f400-bcb7-44dc-9af9-535d583b5dbf None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:39.724219 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8831a-9ad5-444a-bdee-c1964d724819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:39.724858 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8831a-9ad5-444a-bdee-c1964d724819 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:39.725132 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8831a-9ad5-444a-bdee-c1964d724819 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:39.725396 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8831a-9ad5-444a-bdee-c1964d724819 None admin] PATH_INFO: `/v3/projects/85323b48b377409bb1a44ca2c635e0c4` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:39.726569 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8831a-9ad5-444a-bdee-c1964d724819 None admin] RBAC: Authorizing `identity:get_project(project_id=85323b48b377409bb1a44ca2c635e0c4)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:39.728043 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8831a-9ad5-444a-bdee-c1964d724819 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:39.729983 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 104/207] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:39 2022] GET /identity/v3/projects/85323b48b377409bb1a44ca2c635e0c4 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:39.740398 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f917aab-8533-447d-927a-987695f513fb None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:39.859984 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:39.901764 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f917aab-8533-447d-927a-987695f513fb None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:39.966467 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050d859-48e1-4e79-8892-a802e172de61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:39.967390 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050d859-48e1-4e79-8892-a802e172de61 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:39.967795 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050d859-48e1-4e79-8892-a802e172de61 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:39.968259 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050d859-48e1-4e79-8892-a802e172de61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:39.969582 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050d859-48e1-4e79-8892-a802e172de61 None admin] RBAC: Adding query filter params (role.id=f396be01985a422c96d757a4c77a1fb1, scope.project.id=85323b48b377409bb1a44ca2c635e0c4, user.id=e5a369d7664943c58f1d09acd6842c5e) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:39.970123 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050d859-48e1-4e79-8892-a802e172de61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:39.973632 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050d859-48e1-4e79-8892-a802e172de61 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:39.989571 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 104/208] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:39 2022] GET /identity/v3/role_assignments?user.id=e5a369d7664943c58f1d09acd6842c5e&scope.project.id=85323b48b377409bb1a44ca2c635e0c4&role.id=f396be01985a422c96d757a4c77a1fb1 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:41.507299 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f3b8e-6d7b-4120-bed4-3e11cc88127c None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:41.508078 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f3b8e-6d7b-4120-bed4-3e11cc88127c None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:41.508078 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f3b8e-6d7b-4120-bed4-3e11cc88127c None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:41.509185 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 105/209] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:03:41.514717 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047b80f-01ca-4fa8-995b-6bbb8970ccc5 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:41.515458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047b80f-01ca-4fa8-995b-6bbb8970ccc5 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:41.515458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047b80f-01ca-4fa8-995b-6bbb8970ccc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:41.537136 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-1047b80f-01ca-4fa8-995b-6bbb8970ccc5 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:41.538350 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-1047b80f-01ca-4fa8-995b-6bbb8970ccc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:41.611994 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 105/210] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:03:41.719581 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95adf6-6c54-4313-b8ed-0c6f8122579b None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:41.720113 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95adf6-6c54-4313-b8ed-0c6f8122579b None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:41.720922 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95adf6-6c54-4313-b8ed-0c6f8122579b None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:41.723826 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 106/211] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:41.731666 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebef83b-2233-4c43-9718-39801f5e1201 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:41.732220 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebef83b-2233-4c43-9718-39801f5e1201 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:41.732697 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebef83b-2233-4c43-9718-39801f5e1201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:41.752174 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-6ebef83b-2233-4c43-9718-39801f5e1201 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:41.754283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-6ebef83b-2233-4c43-9718-39801f5e1201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:41.860636 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:41.874164 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 106/212] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:42.104816 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05384dec-25c2-45cd-b4d4-8e0468f25afe None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:42.105302 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05384dec-25c2-45cd-b4d4-8e0468f25afe None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:42.105772 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05384dec-25c2-45cd-b4d4-8e0468f25afe None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:42.108159 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 107/213] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:42.113872 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2d273-7ef7-4510-9619-bbc32205c9ce None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:42.114101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2d273-7ef7-4510-9619-bbc32205c9ce None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:42.114383 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2d273-7ef7-4510-9619-bbc32205c9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:42.138181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05384dec-25c2-45cd-b4d4-8e0468f25afe None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:42.140786 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-4dc2d273-7ef7-4510-9619-bbc32205c9ce None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:42.143121 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-4dc2d273-7ef7-4510-9619-bbc32205c9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:42.256992 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:42.266606 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 107/214] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:03:42.273638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05384dec-25c2-45cd-b4d4-8e0468f25afe None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:42.310014 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11022ae1-3054-4a23-a5fc-73432f9ae097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:42.310687 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11022ae1-3054-4a23-a5fc-73432f9ae097 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:42.310972 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11022ae1-3054-4a23-a5fc-73432f9ae097 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:42.311249 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11022ae1-3054-4a23-a5fc-73432f9ae097 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:42.322525 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11022ae1-3054-4a23-a5fc-73432f9ae097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:42.327702 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-11022ae1-3054-4a23-a5fc-73432f9ae097 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:03:42.327702 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:42.327702 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:42.327702 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:42.327702 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:42.327702 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:42.327702 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:42.327702 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:42.327702 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:42.327702 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:42.327702 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:42.327702 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:42.327702 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:42.327702 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:42.327702 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:42.327702 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:42.328775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:42.328775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:42.328775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:42.328775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:42.328775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:42.328775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:42.328775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:42.328775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:42.328775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:42.328775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:42.328775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:42.328775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:42.328775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:42.328775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:42.328775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:42.328775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:42.329773 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:42.329773 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:42.329773 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:42.329773 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:42.329773 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:42.329773 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:42.329773 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:42.329773 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:42.329773 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:42.329773 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:42.329773 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:03:42.329773 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:03:42.329773 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 108/215] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:42.337190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2d273-7ef7-4510-9619-bbc32205c9ce None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:42.445117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11022ae1-3054-4a23-a5fc-73432f9ae097 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:42.449729 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2d273-7ef7-4510-9619-bbc32205c9ce None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:42.489909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:42.508764 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821e11f-2058-4550-bebc-24fa166b6070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:42.509714 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821e11f-2058-4550-bebc-24fa166b6070 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:42.510148 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821e11f-2058-4550-bebc-24fa166b6070 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:42.510726 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821e11f-2058-4550-bebc-24fa166b6070 None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:42.511760 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821e11f-2058-4550-bebc-24fa166b6070 None admin] RBAC: Adding query filter params (name=member) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:42.512218 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821e11f-2058-4550-bebc-24fa166b6070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:42.514552 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821e11f-2058-4550-bebc-24fa166b6070 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:42.530130 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 108/216] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:03:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:42.539809 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821e11f-2058-4550-bebc-24fa166b6070 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:42.585748 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11022ae1-3054-4a23-a5fc-73432f9ae097 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:42.627888 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9d6d0-cf29-4836-99ac-77f84aafb6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:42.628735 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9d6d0-cf29-4836-99ac-77f84aafb6cc None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:42.629020 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9d6d0-cf29-4836-99ac-77f84aafb6cc None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:42.629295 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9d6d0-cf29-4836-99ac-77f84aafb6cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:42.639688 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9d6d0-cf29-4836-99ac-77f84aafb6cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:42.645238 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-64d9d6d0-cf29-4836-99ac-77f84aafb6cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:42.645238 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:42.645238 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:42.645238 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:42.645238 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:42.645238 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:42.645238 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:42.645238 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:42.645238 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:42.645238 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:42.645238 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:42.645238 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:42.645238 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:42.645238 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:42.645238 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:42.645238 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:42.646110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:42.646110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:42.646110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:42.646110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:42.646110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:42.646110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:42.646110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:42.646110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:42.646110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:42.646110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:42.646110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:42.646110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:42.646110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:42.646110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:42.646110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:42.646110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:42.646949 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:42.646949 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:42.646949 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:42.646949 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:42.646949 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:42.646949 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:42.646949 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:42.646949 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:42.646949 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:42.646949 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:42.646949 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:42.646949 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:03:42.646949 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 109/217] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Sep 13 12:03:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:42.647604 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9d6d0-cf29-4836-99ac-77f84aafb6cc None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:42.664910 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:42.708943 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821e11f-2058-4550-bebc-24fa166b6070 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:42.755978 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa8ae8-396f-4b49-80a5-5e0c8f7f0234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:42.757021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa8ae8-396f-4b49-80a5-5e0c8f7f0234 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:42.757514 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa8ae8-396f-4b49-80a5-5e0c8f7f0234 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:42.758016 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa8ae8-396f-4b49-80a5-5e0c8f7f0234 None admin] PATH_INFO: `/v3/users/fd1d8b84d83841ef8b3f085749d21474` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:42.768090 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9d6d0-cf29-4836-99ac-77f84aafb6cc None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:42.783823 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa8ae8-396f-4b49-80a5-5e0c8f7f0234 None admin] RBAC: Authorizing `identity:get_user(user_id=fd1d8b84d83841ef8b3f085749d21474)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:42.787886 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa8ae8-396f-4b49-80a5-5e0c8f7f0234 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:42.791266 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 109/218] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:42 2022] GET /identity/v3/users/fd1d8b84d83841ef8b3f085749d21474 => generated 297 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:42.799664 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa8ae8-396f-4b49-80a5-5e0c8f7f0234 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:42.808632 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092a892-40a2-4276-8edf-1d49f02b71a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:42.809278 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092a892-40a2-4276-8edf-1d49f02b71a7 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:42.809558 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092a892-40a2-4276-8edf-1d49f02b71a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:42.809831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092a892-40a2-4276-8edf-1d49f02b71a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:42.811014 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092a892-40a2-4276-8edf-1d49f02b71a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:42.812475 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092a892-40a2-4276-8edf-1d49f02b71a7 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:42.814076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 110/219] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:42.819571 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092a892-40a2-4276-8edf-1d49f02b71a7 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:42.858442 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:42.929104 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa8ae8-396f-4b49-80a5-5e0c8f7f0234 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:42.946768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:42.974492 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9e03a-bfa3-44e4-8eb1-bf3682c2424f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:42.975305 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9e03a-bfa3-44e4-8eb1-bf3682c2424f None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:42.975594 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9e03a-bfa3-44e4-8eb1-bf3682c2424f None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:42.975961 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9e03a-bfa3-44e4-8eb1-bf3682c2424f None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:42.976711 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9e03a-bfa3-44e4-8eb1-bf3682c2424f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:42.977019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9e03a-bfa3-44e4-8eb1-bf3682c2424f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:42.978407 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9e03a-bfa3-44e4-8eb1-bf3682c2424f None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:42.981086 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092a892-40a2-4276-8edf-1d49f02b71a7 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:42.987331 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 110/220] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:42.987911 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9e03a-bfa3-44e4-8eb1-bf3682c2424f None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:43.045217 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6d08c-0d67-4295-8f28-2b678c912953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:43.046440 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6d08c-0d67-4295-8f28-2b678c912953 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:43.046761 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6d08c-0d67-4295-8f28-2b678c912953 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:43.047040 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6d08c-0d67-4295-8f28-2b678c912953 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:43.122044 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9e03a-bfa3-44e4-8eb1-bf3682c2424f None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:43.130319 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:43.130874 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6d08c-0d67-4295-8f28-2b678c912953 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:43.132397 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6d08c-0d67-4295-8f28-2b678c912953 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:43.176121 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce91c80-655d-452a-a846-83388b1c478f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:43.177020 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce91c80-655d-452a-a846-83388b1c478f None admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:43.177439 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce91c80-655d-452a-a846-83388b1c478f None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:43.177885 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce91c80-655d-452a-a846-83388b1c478f None admin] PATH_INFO: `/v3/users` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:43.178935 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce91c80-655d-452a-a846-83388b1c478f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:43.181791 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce91c80-655d-452a-a846-83388b1c478f None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:43.213441 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 111/221] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Sep 13 12:03:42 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:43.214727 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce91c80-655d-452a-a846-83388b1c478f None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:43.233671 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:43.269962 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 111/222] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:03:43.276614 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6d08c-0d67-4295-8f28-2b678c912953 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:43.397927 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce91c80-655d-452a-a846-83388b1c478f None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:43.437267 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6d08c-0d67-4295-8f28-2b678c912953 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:43.450959 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd3150-24ca-4e3b-82ff-fafda67848dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:43.451615 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd3150-24ca-4e3b-82ff-fafda67848dd None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:43.451896 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd3150-24ca-4e3b-82ff-fafda67848dd None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:43.452173 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd3150-24ca-4e3b-82ff-fafda67848dd None admin] PATH_INFO: `/v3/users/e5a369d7664943c58f1d09acd6842c5e` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:43.453814 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd3150-24ca-4e3b-82ff-fafda67848dd None admin] RBAC: Authorizing `identity:get_user(user_id=e5a369d7664943c58f1d09acd6842c5e)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:43.455670 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd3150-24ca-4e3b-82ff-fafda67848dd None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:43.465057 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 112/223] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:43 2022] GET /identity/v3/users/e5a369d7664943c58f1d09acd6842c5e => generated 283 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:43.465057 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eeaac5-4cc1-425b-b9c0-d8897bc004ad None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:43.465057 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eeaac5-4cc1-425b-b9c0-d8897bc004ad None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:43.465057 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eeaac5-4cc1-425b-b9c0-d8897bc004ad None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:43.465057 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 113/224] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:43.465057 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eeaac5-4cc1-425b-b9c0-d8897bc004ad None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:43.493075 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e501850-12c8-4bc4-ac80-9297220646fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:43.493075 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e501850-12c8-4bc4-ac80-9297220646fd None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:43.493075 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e501850-12c8-4bc4-ac80-9297220646fd None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:43.493075 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e501850-12c8-4bc4-ac80-9297220646fd None admin] PATH_INFO: `/v3/projects/85323b48b377409bb1a44ca2c635e0c4` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:43.494364 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e501850-12c8-4bc4-ac80-9297220646fd None admin] RBAC: Authorizing `identity:get_project(project_id=85323b48b377409bb1a44ca2c635e0c4)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:43.495940 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e501850-12c8-4bc4-ac80-9297220646fd None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:43.497609 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 112/225] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:43 2022] GET /identity/v3/projects/85323b48b377409bb1a44ca2c635e0c4 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:43.501918 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ed9b7-68bd-4132-94e8-4ee26142935d None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:43.501918 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ed9b7-68bd-4132-94e8-4ee26142935d None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:43.501918 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ed9b7-68bd-4132-94e8-4ee26142935d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:43.519688 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:43.520287 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-bb8ed9b7-68bd-4132-94e8-4ee26142935d None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:43.522751 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-bb8ed9b7-68bd-4132-94e8-4ee26142935d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:43.575551 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:43.609483 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eeaac5-4cc1-425b-b9c0-d8897bc004ad None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:43.621775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 113/226] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:43.624275 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ed9b7-68bd-4132-94e8-4ee26142935d None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:43.658669 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bc494-d715-4080-aeed-adbbea223f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:43.660392 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bc494-d715-4080-aeed-adbbea223f80 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:43.660900 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bc494-d715-4080-aeed-adbbea223f80 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:43.661192 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bc494-d715-4080-aeed-adbbea223f80 None admin] PATH_INFO: `/v3/projects/85323b48b377409bb1a44ca2c635e0c4` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:43.662588 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bc494-d715-4080-aeed-adbbea223f80 None admin] RBAC: Authorizing `identity:get_project(project_id=85323b48b377409bb1a44ca2c635e0c4)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:43.664135 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bc494-d715-4080-aeed-adbbea223f80 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:43.666494 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 114/227] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:43 2022] GET /identity/v3/projects/85323b48b377409bb1a44ca2c635e0c4 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:43.673606 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bc494-d715-4080-aeed-adbbea223f80 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:43.765334 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ed9b7-68bd-4132-94e8-4ee26142935d None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:43.810297 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:43.818403 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bc494-d715-4080-aeed-adbbea223f80 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:43.821251 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fff489-c186-4b2a-b25d-f5c4c9f780d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:43.822848 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fff489-c186-4b2a-b25d-f5c4c9f780d0 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:43.823183 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fff489-c186-4b2a-b25d-f5c4c9f780d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:43.823466 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fff489-c186-4b2a-b25d-f5c4c9f780d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:43.824246 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fff489-c186-4b2a-b25d-f5c4c9f780d0 None admin] RBAC: Adding query filter params (role.id=ab14a68bf5b54561badd35b83e6acaf5, scope.project.id=85323b48b377409bb1a44ca2c635e0c4, user.id=fd1d8b84d83841ef8b3f085749d21474) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:43.824572 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fff489-c186-4b2a-b25d-f5c4c9f780d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:43.826038 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fff489-c186-4b2a-b25d-f5c4c9f780d0 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:43.842648 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 114/228] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:43 2022] GET /identity/v3/role_assignments?user.id=fd1d8b84d83841ef8b3f085749d21474&scope.project.id=85323b48b377409bb1a44ca2c635e0c4&role.id=ab14a68bf5b54561badd35b83e6acaf5 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:43.884376 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f137005-6807-4053-b41d-ecdb1e7e180a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:43.885064 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f137005-6807-4053-b41d-ecdb1e7e180a None admin] REQUEST_METHOD: `PUT` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:43.885342 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f137005-6807-4053-b41d-ecdb1e7e180a None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:43.885617 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f137005-6807-4053-b41d-ecdb1e7e180a None admin] PATH_INFO: `/v3/projects/85323b48b377409bb1a44ca2c635e0c4/users/e5a369d7664943c58f1d09acd6842c5e/roles/5609ac7373ba400593bba6d811e3aa72` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:43.887799 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f137005-6807-4053-b41d-ecdb1e7e180a None admin] RBAC: Authorizing `identity:create_grant(project_id=85323b48b377409bb1a44ca2c635e0c4, user_id=e5a369d7664943c58f1d09acd6842c5e, role_id=5609ac7373ba400593bba6d811e3aa72)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:43.889360 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f137005-6807-4053-b41d-ecdb1e7e180a None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:43.913987 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 115/229] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Sep 13 12:03:43 2022] PUT /identity/v3/projects/85323b48b377409bb1a44ca2c635e0c4/users/e5a369d7664943c58f1d09acd6842c5e/roles/5609ac7373ba400593bba6d811e3aa72 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:03:44.013475 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fff489-c186-4b2a-b25d-f5c4c9f780d0 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:44.079946 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:44.166641 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fff489-c186-4b2a-b25d-f5c4c9f780d0 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:44.232383 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98724de-7d9f-4983-b420-338fb5e27c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:44.233336 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98724de-7d9f-4983-b420-338fb5e27c09 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:44.233760 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98724de-7d9f-4983-b420-338fb5e27c09 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:44.234168 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98724de-7d9f-4983-b420-338fb5e27c09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:44.254324 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98724de-7d9f-4983-b420-338fb5e27c09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:44.264294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-d98724de-7d9f-4983-b420-338fb5e27c09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:03:44.264294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:44.264294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:44.264294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:44.264294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:44.264294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:44.264294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:44.264294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:44.264294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:44.264294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:44.264294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:44.264294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:44.264294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:44.264294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:44.264294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:44.264294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:44.265244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:44.265244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:44.265244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:44.265244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:44.265244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:44.265244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:44.265244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:44.265244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:44.265244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:44.265244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:44.265244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:44.265244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:44.265244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:44.265244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:44.265244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:44.265244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:44.266027 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:44.266027 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:44.266027 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:44.266027 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:44.266027 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:44.266027 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:44.266027 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:44.266027 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:44.266027 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:44.266027 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:44.266027 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:03:44.266027 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:03:44.266721 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 115/230] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Sep 13 12:03:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:44.272399 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f137005-6807-4053-b41d-ecdb1e7e180a None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:44.412956 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f137005-6807-4053-b41d-ecdb1e7e180a None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:44.457924 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfde11-25db-493e-a161-166e867e8fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:44.458542 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfde11-25db-493e-a161-166e867e8fd2 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:44.458856 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfde11-25db-493e-a161-166e867e8fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:44.459135 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cfde11-25db-493e-a161-166e867e8fd2 None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:44.459880 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfde11-25db-493e-a161-166e867e8fd2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:44.460189 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfde11-25db-493e-a161-166e867e8fd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:44.461793 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cfde11-25db-493e-a161-166e867e8fd2 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:44.472592 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 116/231] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:44.478709 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98724de-7d9f-4983-b420-338fb5e27c09 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:44.625104 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:44.629341 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98724de-7d9f-4983-b420-338fb5e27c09 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:44.706849 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49881fe2-67c9-469a-9bed-597ce6ccdf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:44.707565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49881fe2-67c9-469a-9bed-597ce6ccdf60 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:44.707845 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49881fe2-67c9-469a-9bed-597ce6ccdf60 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:44.708123 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49881fe2-67c9-469a-9bed-597ce6ccdf60 None admin] PATH_INFO: `/v3/users/e5a369d7664943c58f1d09acd6842c5e` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:44.715364 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49881fe2-67c9-469a-9bed-597ce6ccdf60 None admin] RBAC: Authorizing `identity:get_user(user_id=e5a369d7664943c58f1d09acd6842c5e)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:44.716855 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49881fe2-67c9-469a-9bed-597ce6ccdf60 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:44.718881 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 116/232] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:44 2022] GET /identity/v3/users/e5a369d7664943c58f1d09acd6842c5e => generated 283 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:44.724578 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfde11-25db-493e-a161-166e867e8fd2 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:44.759650 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:44.868474 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cfde11-25db-493e-a161-166e867e8fd2 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:44.916537 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d4050-f227-4624-b7a3-25e59bbd711f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:44.917188 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d4050-f227-4624-b7a3-25e59bbd711f None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:44.917469 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d4050-f227-4624-b7a3-25e59bbd711f None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:44.917742 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d4050-f227-4624-b7a3-25e59bbd711f None admin] PATH_INFO: `/v3/projects/85323b48b377409bb1a44ca2c635e0c4` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:44.918920 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d4050-f227-4624-b7a3-25e59bbd711f None admin] RBAC: Authorizing `identity:get_project(project_id=85323b48b377409bb1a44ca2c635e0c4)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:44.920378 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d4050-f227-4624-b7a3-25e59bbd711f None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:44.922021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 117/233] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:44 2022] GET /identity/v3/projects/85323b48b377409bb1a44ca2c635e0c4 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:44.928465 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49881fe2-67c9-469a-9bed-597ce6ccdf60 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:45.049298 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49881fe2-67c9-469a-9bed-597ce6ccdf60 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:45.099306 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da69190-e24a-4d24-b8e8-5e3d2ab5c938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:45.099975 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da69190-e24a-4d24-b8e8-5e3d2ab5c938 None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:45.100255 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da69190-e24a-4d24-b8e8-5e3d2ab5c938 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:45.100532 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da69190-e24a-4d24-b8e8-5e3d2ab5c938 None admin] PATH_INFO: `/v3/projects/85323b48b377409bb1a44ca2c635e0c4/users/e5a369d7664943c58f1d09acd6842c5e/roles/f396be01985a422c96d757a4c77a1fb1` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:45.104651 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da69190-e24a-4d24-b8e8-5e3d2ab5c938 None admin] RBAC: Authorizing `identity:create_grant(project_id=85323b48b377409bb1a44ca2c635e0c4, user_id=e5a369d7664943c58f1d09acd6842c5e, role_id=f396be01985a422c96d757a4c77a1fb1)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:45.106281 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da69190-e24a-4d24-b8e8-5e3d2ab5c938 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:45.124727 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 117/234] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Sep 13 12:03:44 2022] PUT /identity/v3/projects/85323b48b377409bb1a44ca2c635e0c4/users/e5a369d7664943c58f1d09acd6842c5e/roles/f396be01985a422c96d757a4c77a1fb1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:03:46.930194 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cef36-11b0-4c0c-9961-acd4929b1739 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:46.931052 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cef36-11b0-4c0c-9961-acd4929b1739 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:46.931603 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cef36-11b0-4c0c-9961-acd4929b1739 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:46.933670 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 118/235] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:46.939767 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c47a5-16f5-4988-bcdc-5a0b625f0336 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:46.940642 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c47a5-16f5-4988-bcdc-5a0b625f0336 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:46.941066 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c47a5-16f5-4988-bcdc-5a0b625f0336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:46.967670 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-5b6c47a5-16f5-4988-bcdc-5a0b625f0336 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:46.969119 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-5b6c47a5-16f5-4988-bcdc-5a0b625f0336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:47.001569 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:47.069323 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 118/236] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:47.231107 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ad1cd-0aa5-4f84-bb97-123edfc5fe4a None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:47.231601 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ad1cd-0aa5-4f84-bb97-123edfc5fe4a None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:47.232055 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ad1cd-0aa5-4f84-bb97-123edfc5fe4a None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:47.233610 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 119/237] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:03:47.239616 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fc3bf-d7f1-472e-8c1a-3c74d6ae6c48 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:47.240104 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fc3bf-d7f1-472e-8c1a-3c74d6ae6c48 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:47.240525 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fc3bf-d7f1-472e-8c1a-3c74d6ae6c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:47.267635 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-189fc3bf-d7f1-472e-8c1a-3c74d6ae6c48 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:47.269764 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-189fc3bf-d7f1-472e-8c1a-3c74d6ae6c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:47.350888 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 119/238] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:47.370922 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd2dde-9bf5-4c71-ada3-7da90f797eb1 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:47.371542 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd2dde-9bf5-4c71-ada3-7da90f797eb1 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:47.372046 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd2dde-9bf5-4c71-ada3-7da90f797eb1 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:47.373616 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 120/239] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:47.379313 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65230350-55e8-43e7-a438-1852c3153e81 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:47.379863 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65230350-55e8-43e7-a438-1852c3153e81 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:47.380338 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65230350-55e8-43e7-a438-1852c3153e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:47.399671 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1bccb-1e86-46a4-ba78-10975dd3a5a0 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:47.399978 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1bccb-1e86-46a4-ba78-10975dd3a5a0 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:47.400226 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1bccb-1e86-46a4-ba78-10975dd3a5a0 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:47.401813 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 121/240] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:03:47.406377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-65230350-55e8-43e7-a438-1852c3153e81 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:47.406377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-65230350-55e8-43e7-a438-1852c3153e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:47.408108 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8ad24-8ab8-4080-b93e-dee8be5ef534 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:47.408602 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8ad24-8ab8-4080-b93e-dee8be5ef534 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:47.409794 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8ad24-8ab8-4080-b93e-dee8be5ef534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:47.432438 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-bbb8ad24-8ab8-4080-b93e-dee8be5ef534 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:47.434322 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-bbb8ad24-8ab8-4080-b93e-dee8be5ef534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:47.536086 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 120/241] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:47.537715 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65230350-55e8-43e7-a438-1852c3153e81 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:47.564103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 122/242] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:03:47.577632 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:47.700215 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65230350-55e8-43e7-a438-1852c3153e81 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:47.719549 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8ad24-8ab8-4080-b93e-dee8be5ef534 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:47.755816 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:47.775679 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ac4a9-9f69-4cc0-8dee-e309d3e9366a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:47.778357 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ac4a9-9f69-4cc0-8dee-e309d3e9366a None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:47.778897 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ac4a9-9f69-4cc0-8dee-e309d3e9366a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:47.787129 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ac4a9-9f69-4cc0-8dee-e309d3e9366a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:47.813727 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ac4a9-9f69-4cc0-8dee-e309d3e9366a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:47.818768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-997ac4a9-9f69-4cc0-8dee-e309d3e9366a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:03:47.818768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:47.818768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:47.818768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:47.818768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:47.818768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:47.818768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:47.818768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:47.818768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:47.818768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:47.818768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:47.818768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:47.818768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:47.818768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:47.818768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:47.818768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:47.819675 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:47.819675 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:47.819675 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:47.819675 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:47.819675 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:47.819675 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:47.819675 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:47.819675 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:47.819675 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:47.819675 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:47.819675 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:47.819675 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:47.819675 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:47.819675 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:47.819675 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:47.819675 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:47.820828 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:47.820828 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:47.820828 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:47.820828 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:47.820828 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:47.820828 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:47.820828 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:47.820828 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:47.820828 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:47.820828 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:47.820828 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:03:47.820828 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:03:47.820828 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 121/243] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:47.827075 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ac4a9-9f69-4cc0-8dee-e309d3e9366a None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:47.878974 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8ad24-8ab8-4080-b93e-dee8be5ef534 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:47.935624 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b3072-c323-4b6a-adc5-0ea7f77951f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:47.936579 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b3072-c323-4b6a-adc5-0ea7f77951f9 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:47.936860 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b3072-c323-4b6a-adc5-0ea7f77951f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:47.937133 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b3072-c323-4b6a-adc5-0ea7f77951f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:47.950201 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b3072-c323-4b6a-adc5-0ea7f77951f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:47.957562 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-056b3072-c323-4b6a-adc5-0ea7f77951f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:47.957562 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:47.957562 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:47.957562 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:47.957562 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:47.957562 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:47.957562 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:47.957562 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:47.957562 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:47.957562 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:47.957562 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:47.957562 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:47.957562 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:47.957562 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:47.957562 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:47.957562 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:47.958534 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:47.958534 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:47.958534 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:47.958534 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:47.958534 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:47.958534 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:47.958534 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:47.958534 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:47.958534 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:47.958534 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:47.958534 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:47.958534 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:47.958534 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:47.958534 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:47.958534 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:47.958534 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:47.959426 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:47.959426 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:47.959426 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:47.959426 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:47.959426 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:47.959426 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:47.959426 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:47.959426 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:47.959426 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:47.959426 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:47.959426 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:03:47.959426 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:03:47.959426 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 123/244] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Sep 13 12:03:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:47.965172 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b3072-c323-4b6a-adc5-0ea7f77951f9 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:48.006217 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:48.033390 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ac4a9-9f69-4cc0-8dee-e309d3e9366a None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:48.068062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:48.076387 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4c378-1eb3-4292-a134-1106a103eb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:48.077002 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4c378-1eb3-4292-a134-1106a103eb42 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:48.077280 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4c378-1eb3-4292-a134-1106a103eb42 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:48.077554 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4c378-1eb3-4292-a134-1106a103eb42 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:48.078225 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4c378-1eb3-4292-a134-1106a103eb42 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:48.078531 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4c378-1eb3-4292-a134-1106a103eb42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:48.079953 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4c378-1eb3-4292-a134-1106a103eb42 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:48.093939 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 122/245] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:03:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:48.093939 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4c378-1eb3-4292-a134-1106a103eb42 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:48.094200 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b3072-c323-4b6a-adc5-0ea7f77951f9 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:48.134483 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11d360-9c8d-44ae-a34e-2d1e70c0d188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:48.135147 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11d360-9c8d-44ae-a34e-2d1e70c0d188 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:48.135428 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11d360-9c8d-44ae-a34e-2d1e70c0d188 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:48.135929 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11d360-9c8d-44ae-a34e-2d1e70c0d188 None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:48.136640 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11d360-9c8d-44ae-a34e-2d1e70c0d188 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:48.136952 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11d360-9c8d-44ae-a34e-2d1e70c0d188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:48.138341 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11d360-9c8d-44ae-a34e-2d1e70c0d188 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:48.147741 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 124/246] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:48.148595 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11d360-9c8d-44ae-a34e-2d1e70c0d188 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:48.224581 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4c378-1eb3-4292-a134-1106a103eb42 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:48.263907 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862c435-6d93-44fd-ab25-9160c4699001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:48.264894 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862c435-6d93-44fd-ab25-9160c4699001 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:48.265350 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862c435-6d93-44fd-ab25-9160c4699001 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:48.265808 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862c435-6d93-44fd-ab25-9160c4699001 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:48.267337 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862c435-6d93-44fd-ab25-9160c4699001 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:48.268837 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862c435-6d93-44fd-ab25-9160c4699001 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:48.275093 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 123/247] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:48.275709 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862c435-6d93-44fd-ab25-9160c4699001 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:48.289647 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:48.309470 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11d360-9c8d-44ae-a34e-2d1e70c0d188 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:48.360253 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977cd7f-34a1-4d5a-9bf1-d5f338eeefed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:48.361081 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977cd7f-34a1-4d5a-9bf1-d5f338eeefed None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:48.361501 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977cd7f-34a1-4d5a-9bf1-d5f338eeefed None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:48.361917 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977cd7f-34a1-4d5a-9bf1-d5f338eeefed None admin] PATH_INFO: `/v3/roles/member` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:48.374103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:48.379976 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977cd7f-34a1-4d5a-9bf1-d5f338eeefed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:48.388311 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-5977cd7f-34a1-4d5a-9bf1-d5f338eeefed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:03:48.388311 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:48.388311 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:48.388311 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:48.388311 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:48.388311 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:48.388311 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:48.388311 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:48.388311 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:48.388311 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:48.388311 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:48.388311 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:48.388311 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:48.388311 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:48.388311 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:48.388311 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:48.389297 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:48.389297 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:48.389297 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:48.389297 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:48.389297 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:48.389297 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:48.389297 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:48.389297 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:48.389297 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:48.389297 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:48.389297 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:48.389297 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:48.389297 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:48.389297 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:48.389297 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:48.389297 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:48.390118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:48.390118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:48.390118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:48.390118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:48.390118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:48.390118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:48.390118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:48.390118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:48.390118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:48.390118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:48.390118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:03:48.390118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:03:48.390118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 125/248] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:48.394453 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862c435-6d93-44fd-ab25-9160c4699001 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:48.395697 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977cd7f-34a1-4d5a-9bf1-d5f338eeefed None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:48.449653 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a48897-6f08-4418-a863-82fd6da07c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:48.450572 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a48897-6f08-4418-a863-82fd6da07c47 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:48.451031 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a48897-6f08-4418-a863-82fd6da07c47 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:48.451451 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a48897-6f08-4418-a863-82fd6da07c47 None admin] PATH_INFO: `/v3/users/616f8d71ebce4404ad8cafca6f9eea78` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:48.476427 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a48897-6f08-4418-a863-82fd6da07c47 None admin] RBAC: Authorizing `identity:get_user(user_id=616f8d71ebce4404ad8cafca6f9eea78)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:48.478782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a48897-6f08-4418-a863-82fd6da07c47 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:48.481454 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 124/249] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:48 2022] GET /identity/v3/users/616f8d71ebce4404ad8cafca6f9eea78 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:48.482598 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a48897-6f08-4418-a863-82fd6da07c47 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:48.515193 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977cd7f-34a1-4d5a-9bf1-d5f338eeefed None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:48.568548 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63476fd8-ee37-4b21-b8e6-75ec03cf5523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:48.569470 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63476fd8-ee37-4b21-b8e6-75ec03cf5523 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:48.569892 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63476fd8-ee37-4b21-b8e6-75ec03cf5523 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:48.570311 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63476fd8-ee37-4b21-b8e6-75ec03cf5523 None admin] PATH_INFO: `/v3/users/e5a369d7664943c58f1d09acd6842c5e` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:48.572041 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63476fd8-ee37-4b21-b8e6-75ec03cf5523 None admin] RBAC: Authorizing `identity:get_user(user_id=e5a369d7664943c58f1d09acd6842c5e)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:48.574569 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63476fd8-ee37-4b21-b8e6-75ec03cf5523 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:48.576775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:48.577130 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 126/250] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:48 2022] GET /identity/v3/users/e5a369d7664943c58f1d09acd6842c5e => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:48.578347 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63476fd8-ee37-4b21-b8e6-75ec03cf5523 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:48.620071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a48897-6f08-4418-a863-82fd6da07c47 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:48.655514 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7f331-5779-47e0-b355-0d0dec2ebb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:48.656188 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7f331-5779-47e0-b355-0d0dec2ebb2a None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:48.656472 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7f331-5779-47e0-b355-0d0dec2ebb2a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:48.656741 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7f331-5779-47e0-b355-0d0dec2ebb2a None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:48.657397 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7f331-5779-47e0-b355-0d0dec2ebb2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:48.659129 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7f331-5779-47e0-b355-0d0dec2ebb2a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:48.680741 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:48.682914 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 125/251] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Sep 13 12:03:48 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:48.683756 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7f331-5779-47e0-b355-0d0dec2ebb2a None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:48.743390 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63476fd8-ee37-4b21-b8e6-75ec03cf5523 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:48.791844 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bda86-aae3-4e21-a3b7-6db618db6bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:48.792933 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bda86-aae3-4e21-a3b7-6db618db6bba None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:48.793376 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bda86-aae3-4e21-a3b7-6db618db6bba None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:48.793798 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bda86-aae3-4e21-a3b7-6db618db6bba None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:48.794886 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75bda86-aae3-4e21-a3b7-6db618db6bba None admin] RBAC: Adding query filter params (name=member) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:48.795401 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75bda86-aae3-4e21-a3b7-6db618db6bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:48.797064 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75bda86-aae3-4e21-a3b7-6db618db6bba None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:48.814665 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 127/252] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:03:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:48.820111 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bda86-aae3-4e21-a3b7-6db618db6bba None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:48.829314 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7f331-5779-47e0-b355-0d0dec2ebb2a None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:48.868172 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:48.891555 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be0bab9-bfb3-46c3-87a7-7f03435aa0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:48.892627 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0bab9-bfb3-46c3-87a7-7f03435aa0b8 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:48.892974 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0bab9-bfb3-46c3-87a7-7f03435aa0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:48.893439 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be0bab9-bfb3-46c3-87a7-7f03435aa0b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:48.971031 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bda86-aae3-4e21-a3b7-6db618db6bba None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:49.006335 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0bab9-bfb3-46c3-87a7-7f03435aa0b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:49.007555 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be0bab9-bfb3-46c3-87a7-7f03435aa0b8 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:49.009351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:49.019561 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ff524-91ea-4e62-83ad-0a4aa15213ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:49.020177 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ff524-91ea-4e62-83ad-0a4aa15213ab None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:49.020461 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ff524-91ea-4e62-83ad-0a4aa15213ab None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:49.020739 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ff524-91ea-4e62-83ad-0a4aa15213ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:49.138485 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ff524-91ea-4e62-83ad-0a4aa15213ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:49.140207 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ff524-91ea-4e62-83ad-0a4aa15213ab None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:49.160284 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 126/253] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:03:49.163540 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94820ed9-acf8-4e9b-b144-086eb64ed95b None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:49.164034 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94820ed9-acf8-4e9b-b144-086eb64ed95b None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:49.164718 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94820ed9-acf8-4e9b-b144-086eb64ed95b None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:49.167874 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 127/254] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:49.169317 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94820ed9-acf8-4e9b-b144-086eb64ed95b None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:49.202882 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:49.301500 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94820ed9-acf8-4e9b-b144-086eb64ed95b None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:49.319133 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 128/255] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:03:49.320601 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ff524-91ea-4e62-83ad-0a4aa15213ab None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:49.341132 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa375864-e6e7-493d-bccf-ea74524dd2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:49.341766 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa375864-e6e7-493d-bccf-ea74524dd2ed None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:49.342041 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa375864-e6e7-493d-bccf-ea74524dd2ed None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:49.342323 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa375864-e6e7-493d-bccf-ea74524dd2ed None admin] PATH_INFO: `/v3/users/fd1d8b84d83841ef8b3f085749d21474` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:49.343685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa375864-e6e7-493d-bccf-ea74524dd2ed None admin] RBAC: Authorizing `identity:get_user(user_id=fd1d8b84d83841ef8b3f085749d21474)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:49.345130 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa375864-e6e7-493d-bccf-ea74524dd2ed None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:49.348121 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 128/256] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:49 2022] GET /identity/v3/users/fd1d8b84d83841ef8b3f085749d21474 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:49.349411 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430587ba-4248-4e8b-972d-d20ac407d8f8 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:49.349700 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430587ba-4248-4e8b-972d-d20ac407d8f8 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:49.349965 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430587ba-4248-4e8b-972d-d20ac407d8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:49.371262 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-430587ba-4248-4e8b-972d-d20ac407d8f8 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:49.372755 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-430587ba-4248-4e8b-972d-d20ac407d8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:49.383889 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:49.462880 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 129/257] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:49.464287 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430587ba-4248-4e8b-972d-d20ac407d8f8 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:49.538892 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:49.562647 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ff524-91ea-4e62-83ad-0a4aa15213ab None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:49.684432 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e23d23-27b5-444c-af27-d4ec6293c8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:49.684981 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e23d23-27b5-444c-af27-d4ec6293c8a9 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:49.685266 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e23d23-27b5-444c-af27-d4ec6293c8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:49.685544 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e23d23-27b5-444c-af27-d4ec6293c8a9 None admin] PATH_INFO: `/v3/projects/85323b48b377409bb1a44ca2c635e0c4` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:49.686717 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e23d23-27b5-444c-af27-d4ec6293c8a9 None admin] RBAC: Authorizing `identity:get_project(project_id=85323b48b377409bb1a44ca2c635e0c4)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:49.688247 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e23d23-27b5-444c-af27-d4ec6293c8a9 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:49.690816 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 129/258] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:49 2022] GET /identity/v3/projects/85323b48b377409bb1a44ca2c635e0c4 => generated 302 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:49.691621 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e23d23-27b5-444c-af27-d4ec6293c8a9 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:49.754790 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430587ba-4248-4e8b-972d-d20ac407d8f8 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:49.830156 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a762f-9182-4b17-9a97-e86aa2ff7fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:49.830910 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a762f-9182-4b17-9a97-e86aa2ff7fce None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:49.831241 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a762f-9182-4b17-9a97-e86aa2ff7fce None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:49.831517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a762f-9182-4b17-9a97-e86aa2ff7fce None admin] PATH_INFO: `/v3/projects/85323b48b377409bb1a44ca2c635e0c4` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:49.832840 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a762f-9182-4b17-9a97-e86aa2ff7fce None admin] RBAC: Authorizing `identity:get_project(project_id=85323b48b377409bb1a44ca2c635e0c4)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:49.834298 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a762f-9182-4b17-9a97-e86aa2ff7fce None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:49.843192 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 130/259] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:49 2022] GET /identity/v3/projects/85323b48b377409bb1a44ca2c635e0c4 => generated 302 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:49.845107 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a762f-9182-4b17-9a97-e86aa2ff7fce None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:49.879244 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e23d23-27b5-444c-af27-d4ec6293c8a9 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:49.881644 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:49.934663 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22232dd0-8e14-46d0-8489-a19038bf5fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:49.935318 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22232dd0-8e14-46d0-8489-a19038bf5fa5 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:49.935850 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22232dd0-8e14-46d0-8489-a19038bf5fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:49.936129 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22232dd0-8e14-46d0-8489-a19038bf5fa5 None admin] PATH_INFO: `/v3/projects/85323b48b377409bb1a44ca2c635e0c4` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:49.938166 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22232dd0-8e14-46d0-8489-a19038bf5fa5 None admin] RBAC: Authorizing `identity:get_project(project_id=85323b48b377409bb1a44ca2c635e0c4)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:49.939738 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22232dd0-8e14-46d0-8489-a19038bf5fa5 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:49.941841 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 130/260] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:49 2022] GET /identity/v3/projects/85323b48b377409bb1a44ca2c635e0c4 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:49.943363 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22232dd0-8e14-46d0-8489-a19038bf5fa5 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:49.964267 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:49.978961 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a762f-9182-4b17-9a97-e86aa2ff7fce None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:50.021983 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f794d-f068-4e43-ab2c-1d26d92f666d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:50.022949 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f794d-f068-4e43-ab2c-1d26d92f666d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:50.022949 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f794d-f068-4e43-ab2c-1d26d92f666d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:50.026640 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f794d-f068-4e43-ab2c-1d26d92f666d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:50.026640 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f794d-f068-4e43-ab2c-1d26d92f666d None admin] RBAC: Adding query filter params (role.id=5e1d0d5215694636b5147ed0d216c047, scope.project.id=85323b48b377409bb1a44ca2c635e0c4, user.id=616f8d71ebce4404ad8cafca6f9eea78) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:50.026640 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f794d-f068-4e43-ab2c-1d26d92f666d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:50.026640 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f794d-f068-4e43-ab2c-1d26d92f666d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:50.032952 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 131/261] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:49 2022] GET /identity/v3/role_assignments?user.id=616f8d71ebce4404ad8cafca6f9eea78&scope.project.id=85323b48b377409bb1a44ca2c635e0c4&role.id=5e1d0d5215694636b5147ed0d216c047 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:50.033522 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f794d-f068-4e43-ab2c-1d26d92f666d None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:50.087661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22232dd0-8e14-46d0-8489-a19038bf5fa5 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:50.156965 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d7a12-764d-4a45-b832-9de1ce58e0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:50.158009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d7a12-764d-4a45-b832-9de1ce58e0a4 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:50.158283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d7a12-764d-4a45-b832-9de1ce58e0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:50.158557 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d7a12-764d-4a45-b832-9de1ce58e0a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:50.159981 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d7a12-764d-4a45-b832-9de1ce58e0a4 None admin] RBAC: Adding query filter params (role.id=5609ac7373ba400593bba6d811e3aa72, scope.project.id=85323b48b377409bb1a44ca2c635e0c4, user.id=e5a369d7664943c58f1d09acd6842c5e) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:50.160294 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d7a12-764d-4a45-b832-9de1ce58e0a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:50.161781 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d7a12-764d-4a45-b832-9de1ce58e0a4 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:50.180341 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 131/262] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:49 2022] GET /identity/v3/role_assignments?user.id=e5a369d7664943c58f1d09acd6842c5e&scope.project.id=85323b48b377409bb1a44ca2c635e0c4&role.id=5609ac7373ba400593bba6d811e3aa72 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:50.183959 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d7a12-764d-4a45-b832-9de1ce58e0a4 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:50.245465 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:50.258360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f794d-f068-4e43-ab2c-1d26d92f666d None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:50.321929 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4190e5-27e0-4971-adee-9984012f3b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:50.322592 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4190e5-27e0-4971-adee-9984012f3b97 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:50.322894 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4190e5-27e0-4971-adee-9984012f3b97 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:50.323171 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4190e5-27e0-4971-adee-9984012f3b97 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:50.337208 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4190e5-27e0-4971-adee-9984012f3b97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:50.343037 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-6c4190e5-27e0-4971-adee-9984012f3b97 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:03:50.343037 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:50.343037 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:50.343037 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:50.343037 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:50.343037 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:50.343037 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:50.343037 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:50.343037 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:50.343037 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:50.343037 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:50.343037 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:50.343037 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:50.343037 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:50.343037 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:50.343037 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:50.344782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:50.344782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:50.344782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:50.344782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:50.344782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:50.344782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:50.344782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:50.344782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:50.344782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:50.344782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:50.344782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:50.344782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:50.344782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:50.344782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:50.344782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:50.344782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:50.346212 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:50.346212 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:50.346212 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:50.346212 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:50.346212 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:50.346212 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:50.346212 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:50.346212 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:50.346212 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:50.346212 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:50.346212 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:03:50.346212 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:03:50.346212 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 132/263] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Sep 13 12:03:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:50.358087 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4190e5-27e0-4971-adee-9984012f3b97 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:50.402494 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:50.445827 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d7a12-764d-4a45-b832-9de1ce58e0a4 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:50.508731 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc8218-55dc-4c93-a05d-0c07736e168c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:50.509407 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc8218-55dc-4c93-a05d-0c07736e168c None admin] REQUEST_METHOD: `PUT` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:50.509686 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc8218-55dc-4c93-a05d-0c07736e168c None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:50.509960 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc8218-55dc-4c93-a05d-0c07736e168c None admin] PATH_INFO: `/v3/projects/85323b48b377409bb1a44ca2c635e0c4/users/fd1d8b84d83841ef8b3f085749d21474/roles/ab14a68bf5b54561badd35b83e6acaf5` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:50.513877 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc8218-55dc-4c93-a05d-0c07736e168c None admin] RBAC: Authorizing `identity:create_grant(project_id=85323b48b377409bb1a44ca2c635e0c4, user_id=fd1d8b84d83841ef8b3f085749d21474, role_id=ab14a68bf5b54561badd35b83e6acaf5)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:50.515634 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc8218-55dc-4c93-a05d-0c07736e168c None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:50.546570 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 132/264] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Sep 13 12:03:50 2022] PUT /identity/v3/projects/85323b48b377409bb1a44ca2c635e0c4/users/fd1d8b84d83841ef8b3f085749d21474/roles/ab14a68bf5b54561badd35b83e6acaf5 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:03:50.592657 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4190e5-27e0-4971-adee-9984012f3b97 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:50.632779 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c4e97-59f2-4502-928f-4eb7944300ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:50.633404 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c4e97-59f2-4502-928f-4eb7944300ea None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:50.633684 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c4e97-59f2-4502-928f-4eb7944300ea None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:50.633947 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c4e97-59f2-4502-928f-4eb7944300ea None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:50.634635 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c4e97-59f2-4502-928f-4eb7944300ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:50.634948 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c4e97-59f2-4502-928f-4eb7944300ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:50.636373 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c4e97-59f2-4502-928f-4eb7944300ea None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:50.646954 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 133/265] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:03:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:50.652594 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc8218-55dc-4c93-a05d-0c07736e168c None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:50.776539 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc8218-55dc-4c93-a05d-0c07736e168c None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:50.779173 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:50.819503 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262741ef-0c91-4bb9-8429-36864e89a827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:50.820213 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262741ef-0c91-4bb9-8429-36864e89a827 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:50.820499 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262741ef-0c91-4bb9-8429-36864e89a827 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:50.820771 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262741ef-0c91-4bb9-8429-36864e89a827 None admin] PATH_INFO: `/v3/users/e5a369d7664943c58f1d09acd6842c5e` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:50.822104 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262741ef-0c91-4bb9-8429-36864e89a827 None admin] RBAC: Authorizing `identity:get_user(user_id=e5a369d7664943c58f1d09acd6842c5e)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:50.823715 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262741ef-0c91-4bb9-8429-36864e89a827 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:50.825798 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 133/266] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:50 2022] GET /identity/v3/users/e5a369d7664943c58f1d09acd6842c5e => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:50.832629 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c4e97-59f2-4502-928f-4eb7944300ea None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:50.931144 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:50.958385 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c4e97-59f2-4502-928f-4eb7944300ea None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:50.998604 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523dd66f-47d8-408d-afe5-cffc3d4b6a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:50.999327 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dd66f-47d8-408d-afe5-cffc3d4b6a35 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:50.999530 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dd66f-47d8-408d-afe5-cffc3d4b6a35 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:50.999797 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dd66f-47d8-408d-afe5-cffc3d4b6a35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:51.078792 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523dd66f-47d8-408d-afe5-cffc3d4b6a35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:51.080297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523dd66f-47d8-408d-afe5-cffc3d4b6a35 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:51.172966 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:51.208696 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 134/267] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:03:51.214308 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262741ef-0c91-4bb9-8429-36864e89a827 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:51.376353 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262741ef-0c91-4bb9-8429-36864e89a827 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:51.412743 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8a5ed-c389-4227-8735-9572a123fa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:51.413382 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8a5ed-c389-4227-8735-9572a123fa63 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:51.413658 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8a5ed-c389-4227-8735-9572a123fa63 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:51.413928 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8a5ed-c389-4227-8735-9572a123fa63 None admin] PATH_INFO: `/v3/projects/85323b48b377409bb1a44ca2c635e0c4` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:51.415354 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f8a5ed-c389-4227-8735-9572a123fa63 None admin] RBAC: Authorizing `identity:get_project(project_id=85323b48b377409bb1a44ca2c635e0c4)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:51.416787 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f8a5ed-c389-4227-8735-9572a123fa63 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:51.421058 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 134/268] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:51 2022] GET /identity/v3/projects/85323b48b377409bb1a44ca2c635e0c4 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:51.425992 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523dd66f-47d8-408d-afe5-cffc3d4b6a35 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:51.567950 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523dd66f-47d8-408d-afe5-cffc3d4b6a35 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:51.618908 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1a5c1-0b8a-4500-ad99-e8df8268a932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:51.619513 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1a5c1-0b8a-4500-ad99-e8df8268a932 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:51.619789 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1a5c1-0b8a-4500-ad99-e8df8268a932 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:51.620059 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1a5c1-0b8a-4500-ad99-e8df8268a932 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:51.620769 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1a5c1-0b8a-4500-ad99-e8df8268a932 None admin] RBAC: Adding query filter params (role.id=f396be01985a422c96d757a4c77a1fb1, scope.project.id=85323b48b377409bb1a44ca2c635e0c4, user.id=e5a369d7664943c58f1d09acd6842c5e) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:51.621071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1a5c1-0b8a-4500-ad99-e8df8268a932 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:51.622590 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1a5c1-0b8a-4500-ad99-e8df8268a932 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:51.630353 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 135/269] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:51 2022] GET /identity/v3/role_assignments?user.id=e5a369d7664943c58f1d09acd6842c5e&scope.project.id=85323b48b377409bb1a44ca2c635e0c4&role.id=f396be01985a422c96d757a4c77a1fb1 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:52.242928 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7023182-d573-4bc4-8d1f-b5cfbb1345d1 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:52.243437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7023182-d573-4bc4-8d1f-b5cfbb1345d1 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:52.243512 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7023182-d573-4bc4-8d1f-b5cfbb1345d1 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:52.245023 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 135/270] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:52.252066 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8daa9-69c2-40d7-9acc-c1da60ce2246 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:52.253058 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8daa9-69c2-40d7-9acc-c1da60ce2246 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:52.253132 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8daa9-69c2-40d7-9acc-c1da60ce2246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:52.275957 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-a1b8daa9-69c2-40d7-9acc-c1da60ce2246 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:52.277532 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-a1b8daa9-69c2-40d7-9acc-c1da60ce2246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:52.323242 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:52.369974 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 136/271] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:52.412816 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aead797-95bd-4d7c-ae66-da8b20417ab2 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:52.413175 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aead797-95bd-4d7c-ae66-da8b20417ab2 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:52.413454 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aead797-95bd-4d7c-ae66-da8b20417ab2 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:52.415428 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 136/272] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:52.420990 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363399f8-99ba-4400-b0fd-c53cf4c23fc7 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:52.421273 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363399f8-99ba-4400-b0fd-c53cf4c23fc7 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:52.421546 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363399f8-99ba-4400-b0fd-c53cf4c23fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:52.440709 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-363399f8-99ba-4400-b0fd-c53cf4c23fc7 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:52.442007 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-363399f8-99ba-4400-b0fd-c53cf4c23fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:52.526988 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 137/273] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:52.766672 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aead797-95bd-4d7c-ae66-da8b20417ab2 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:52.806684 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:52.897427 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363399f8-99ba-4400-b0fd-c53cf4c23fc7 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:52.938223 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aead797-95bd-4d7c-ae66-da8b20417ab2 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:53.006683 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05501a3e-d35e-4ae5-b620-cb37c8de3bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:53.008018 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05501a3e-d35e-4ae5-b620-cb37c8de3bfd None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:53.008822 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05501a3e-d35e-4ae5-b620-cb37c8de3bfd None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:53.009528 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05501a3e-d35e-4ae5-b620-cb37c8de3bfd None admin] PATH_INFO: `/v3/roles/member` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:53.026635 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05501a3e-d35e-4ae5-b620-cb37c8de3bfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:53.036436 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-05501a3e-d35e-4ae5-b620-cb37c8de3bfd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:03:53.036436 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:53.036436 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:53.036436 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:53.036436 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:53.036436 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:53.036436 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:53.036436 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:53.036436 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:53.036436 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:53.036436 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:53.036436 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:53.036436 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:53.036436 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:53.036436 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:53.036436 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:53.037349 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:53.037349 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:53.037349 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:53.037349 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:53.037349 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:53.037349 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:53.037349 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:53.037349 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:53.037349 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:53.037349 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:53.037349 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:53.037349 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:53.037349 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:53.037349 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:53.037349 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:53.037349 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:53.038159 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:53.038159 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:53.038159 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:53.038159 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:53.038159 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:53.038159 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:53.038159 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:53.038159 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:53.038159 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:53.038159 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:53.038159 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:03:53.038159 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:03:53.044523 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 137/274] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:53.047349 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05501a3e-d35e-4ae5-b620-cb37c8de3bfd None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:53.066945 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:53.072325 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363399f8-99ba-4400-b0fd-c53cf4c23fc7 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:53.124238 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33aa94-d996-4757-b961-ab230f7c53d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:53.125232 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33aa94-d996-4757-b961-ab230f7c53d0 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:53.126187 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33aa94-d996-4757-b961-ab230f7c53d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:53.126855 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33aa94-d996-4757-b961-ab230f7c53d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:53.128838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33aa94-d996-4757-b961-ab230f7c53d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:53.131320 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33aa94-d996-4757-b961-ab230f7c53d0 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:53.141784 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 138/275] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:53.144441 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33aa94-d996-4757-b961-ab230f7c53d0 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:53.174993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:53.201832 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05501a3e-d35e-4ae5-b620-cb37c8de3bfd None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:53.240434 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f213a-40fa-4f9b-8457-7402c41b9d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:53.241049 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f213a-40fa-4f9b-8457-7402c41b9d30 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:53.241328 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f213a-40fa-4f9b-8457-7402c41b9d30 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:53.241600 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f213a-40fa-4f9b-8457-7402c41b9d30 None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:53.242459 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f213a-40fa-4f9b-8457-7402c41b9d30 None admin] RBAC: Adding query filter params (name=member) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:53.243030 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f213a-40fa-4f9b-8457-7402c41b9d30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:53.244443 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f213a-40fa-4f9b-8457-7402c41b9d30 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:53.259902 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 138/276] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:03:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:53.267366 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f213a-40fa-4f9b-8457-7402c41b9d30 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:53.267955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33aa94-d996-4757-b961-ab230f7c53d0 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:53.310176 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc878e29-4e38-475b-9063-9cfa0d561f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:53.311390 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc878e29-4e38-475b-9063-9cfa0d561f11 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:53.311876 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc878e29-4e38-475b-9063-9cfa0d561f11 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:53.313332 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc878e29-4e38-475b-9063-9cfa0d561f11 None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:53.314235 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc878e29-4e38-475b-9063-9cfa0d561f11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:53.316044 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc878e29-4e38-475b-9063-9cfa0d561f11 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:53.346348 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 139/277] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Sep 13 12:03:53 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:03:53.346348 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd6a6f-8cca-4f0f-895a-62efcf7d8c95 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:53.346348 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd6a6f-8cca-4f0f-895a-62efcf7d8c95 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:53.346348 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd6a6f-8cca-4f0f-895a-62efcf7d8c95 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:53.346348 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 140/278] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:53.352423 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c447878-30be-435d-ade2-9e3781fcb1a5 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:53.352750 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c447878-30be-435d-ade2-9e3781fcb1a5 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:53.353076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c447878-30be-435d-ade2-9e3781fcb1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:53.389312 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-5c447878-30be-435d-ade2-9e3781fcb1a5 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:53.390947 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-5c447878-30be-435d-ade2-9e3781fcb1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:53.425086 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:53.442546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f213a-40fa-4f9b-8457-7402c41b9d30 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:53.500562 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed57fe5-f2e6-4d1c-83db-e2860453dc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:53.502895 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 141/279] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:53.506894 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed57fe5-f2e6-4d1c-83db-e2860453dc93 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:53.507510 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed57fe5-f2e6-4d1c-83db-e2860453dc93 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:53.507971 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed57fe5-f2e6-4d1c-83db-e2860453dc93 None admin] PATH_INFO: `/v3/users/ca5b85d17a1b42dfa1e19f53e391f8c4` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:53.525637 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed57fe5-f2e6-4d1c-83db-e2860453dc93 None admin] RBAC: Authorizing `identity:get_user(user_id=ca5b85d17a1b42dfa1e19f53e391f8c4)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:53.527657 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed57fe5-f2e6-4d1c-83db-e2860453dc93 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:53.530147 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 139/280] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:53 2022] GET /identity/v3/users/ca5b85d17a1b42dfa1e19f53e391f8c4 => generated 293 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:53.537005 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c447878-30be-435d-ade2-9e3781fcb1a5 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:53.665895 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c447878-30be-435d-ade2-9e3781fcb1a5 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:53.707926 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae4365-08b5-4909-955e-47ba882e4147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:53.708545 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae4365-08b5-4909-955e-47ba882e4147 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:53.708822 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae4365-08b5-4909-955e-47ba882e4147 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:53.709092 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae4365-08b5-4909-955e-47ba882e4147 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:53.709823 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae4365-08b5-4909-955e-47ba882e4147 None admin] RBAC: Adding query filter params (role.id=ab14a68bf5b54561badd35b83e6acaf5, user.id=ca5b85d17a1b42dfa1e19f53e391f8c4, scope.system=all) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:53.710228 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae4365-08b5-4909-955e-47ba882e4147 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:53.711683 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae4365-08b5-4909-955e-47ba882e4147 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:53.717566 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 142/281] 10.222.0.15 () {56 vars in 1308 bytes} [Tue Sep 13 12:03:53 2022] GET /identity/v3/role_assignments?user.id=ca5b85d17a1b42dfa1e19f53e391f8c4&scope.system=all&role.id=ab14a68bf5b54561badd35b83e6acaf5 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:53.867020 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed57fe5-f2e6-4d1c-83db-e2860453dc93 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:53.881972 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:53.978092 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c0445-ae5e-42d3-b3a7-9b6daac4b574 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:53.978387 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c0445-ae5e-42d3-b3a7-9b6daac4b574 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:53.978567 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c0445-ae5e-42d3-b3a7-9b6daac4b574 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:53.980699 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 143/282] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:03:53.988054 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8e698-60cc-4435-bed9-6084f25f23c9 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:53.988376 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8e698-60cc-4435-bed9-6084f25f23c9 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:53.988816 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8e698-60cc-4435-bed9-6084f25f23c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:54.010801 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed57fe5-f2e6-4d1c-83db-e2860453dc93 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:54.012973 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-f2f8e698-60cc-4435-bed9-6084f25f23c9 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:54.015108 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-f2f8e698-60cc-4435-bed9-6084f25f23c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:54.038789 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:54.092856 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c8aee-7b88-496f-aeae-004b9c9ebd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:54.093935 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c8aee-7b88-496f-aeae-004b9c9ebd7a None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:54.094421 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c8aee-7b88-496f-aeae-004b9c9ebd7a None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:54.094931 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c8aee-7b88-496f-aeae-004b9c9ebd7a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:54.122111 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c8aee-7b88-496f-aeae-004b9c9ebd7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:54.127112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-fa1c8aee-7b88-496f-aeae-004b9c9ebd7a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:03:54.127112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:54.127112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:54.127112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:54.127112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:54.127112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:54.127112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:54.127112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:54.127112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:54.127112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:54.127112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:54.127112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:54.127112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:54.127112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:54.127112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:54.127112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:54.128661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:54.128661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:54.128661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:54.128661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:54.128661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:54.128661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:54.128661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:54.128661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:54.128661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:54.128661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:54.128661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:54.128661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:54.128661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:54.128661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:54.128661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:54.128661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:54.129913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:54.129913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:54.129913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:54.129913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:54.129913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:54.129913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:54.129913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:54.129913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:54.129913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:54.129913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:54.129913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:03:54.129913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:03:54.131604 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 140/283] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:54.137867 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c8aee-7b88-496f-aeae-004b9c9ebd7a None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:54.159601 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 144/284] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:03:54.273098 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:54.324170 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c8aee-7b88-496f-aeae-004b9c9ebd7a None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:54.377003 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a704fa-3bfd-409e-a237-1aa89d09fd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:54.377658 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a704fa-3bfd-409e-a237-1aa89d09fd5b None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:54.377939 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a704fa-3bfd-409e-a237-1aa89d09fd5b None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:54.378409 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a704fa-3bfd-409e-a237-1aa89d09fd5b None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:54.379118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a704fa-3bfd-409e-a237-1aa89d09fd5b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:54.379423 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a704fa-3bfd-409e-a237-1aa89d09fd5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:54.380811 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a704fa-3bfd-409e-a237-1aa89d09fd5b None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:54.394812 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 141/285] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:03:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:54.400278 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8e698-60cc-4435-bed9-6084f25f23c9 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:54.568952 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8e698-60cc-4435-bed9-6084f25f23c9 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:54.624088 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87b42b-f43e-4a8b-87b9-b15df5b6242e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:54.624734 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87b42b-f43e-4a8b-87b9-b15df5b6242e None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:54.625010 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87b42b-f43e-4a8b-87b9-b15df5b6242e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:54.625277 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87b42b-f43e-4a8b-87b9-b15df5b6242e None admin] PATH_INFO: `/v3/users/616f8d71ebce4404ad8cafca6f9eea78` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:54.626538 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87b42b-f43e-4a8b-87b9-b15df5b6242e None admin] RBAC: Authorizing `identity:get_user(user_id=616f8d71ebce4404ad8cafca6f9eea78)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:54.629546 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87b42b-f43e-4a8b-87b9-b15df5b6242e None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:54.631621 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 145/286] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:54 2022] GET /identity/v3/users/616f8d71ebce4404ad8cafca6f9eea78 => generated 297 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:54.637269 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a704fa-3bfd-409e-a237-1aa89d09fd5b None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:54.760263 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87b42b-f43e-4a8b-87b9-b15df5b6242e None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:54.778458 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:54.810711 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a704fa-3bfd-409e-a237-1aa89d09fd5b None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:54.842281 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:54.853601 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff12ab-9bca-4f74-829a-329bd13e703e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:54.854235 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff12ab-9bca-4f74-829a-329bd13e703e None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:54.854520 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff12ab-9bca-4f74-829a-329bd13e703e None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:54.854836 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff12ab-9bca-4f74-829a-329bd13e703e None admin] PATH_INFO: `/v3/projects/85323b48b377409bb1a44ca2c635e0c4` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:54.856047 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff12ab-9bca-4f74-829a-329bd13e703e None admin] RBAC: Authorizing `identity:get_project(project_id=85323b48b377409bb1a44ca2c635e0c4)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:54.857510 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff12ab-9bca-4f74-829a-329bd13e703e None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:54.859516 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 142/287] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:54 2022] GET /identity/v3/projects/85323b48b377409bb1a44ca2c635e0c4 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:54.868467 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff12ab-9bca-4f74-829a-329bd13e703e None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:54.899760 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87b42b-f43e-4a8b-87b9-b15df5b6242e None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:54.939425 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fcf68-4eb0-45f4-8ab1-24f154b1e0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:54.940696 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fcf68-4eb0-45f4-8ab1-24f154b1e0b0 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:54.941230 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fcf68-4eb0-45f4-8ab1-24f154b1e0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:54.941508 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fcf68-4eb0-45f4-8ab1-24f154b1e0b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:54.953270 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fcf68-4eb0-45f4-8ab1-24f154b1e0b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:54.960305 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-b85fcf68-4eb0-45f4-8ab1-24f154b1e0b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:03:54.960305 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:54.960305 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:54.960305 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:54.960305 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:54.960305 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:54.960305 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:54.960305 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:54.960305 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:54.960305 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:54.960305 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:54.960305 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:54.960305 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:54.960305 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:54.960305 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:54.960305 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:54.961202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:54.961202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:54.961202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:54.961202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:54.961202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:54.961202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:54.961202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:54.961202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:54.961202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:54.961202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:54.961202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:54.961202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:54.961202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:54.961202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:54.961202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:54.961202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:54.963556 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:54.963556 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:54.963556 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:54.963556 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:54.963556 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:54.963556 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:54.963556 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:54.963556 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:54.963556 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:54.963556 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:54.963556 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:03:54.963556 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:03:54.963556 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 146/288] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:03:54.968597 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fcf68-4eb0-45f4-8ab1-24f154b1e0b0 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:55.091939 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:55.104443 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff12ab-9bca-4f74-829a-329bd13e703e None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:55.134880 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fcf68-4eb0-45f4-8ab1-24f154b1e0b0 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:55.173427 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb72582-7928-45fa-a4f4-03ad9e487446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:55.174042 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb72582-7928-45fa-a4f4-03ad9e487446 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:55.174919 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb72582-7928-45fa-a4f4-03ad9e487446 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:55.175201 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb72582-7928-45fa-a4f4-03ad9e487446 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:55.175882 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb72582-7928-45fa-a4f4-03ad9e487446 None admin] RBAC: Adding query filter params (name=member) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:55.176187 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb72582-7928-45fa-a4f4-03ad9e487446 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:55.177585 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb72582-7928-45fa-a4f4-03ad9e487446 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:55.180574 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce14e4-8464-4506-9c02-03dc5b8c3a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:55.181238 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce14e4-8464-4506-9c02-03dc5b8c3a42 None admin] REQUEST_METHOD: `PUT` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:55.181517 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce14e4-8464-4506-9c02-03dc5b8c3a42 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:55.181766 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce14e4-8464-4506-9c02-03dc5b8c3a42 None admin] PATH_INFO: `/v3/projects/85323b48b377409bb1a44ca2c635e0c4/users/616f8d71ebce4404ad8cafca6f9eea78/roles/5e1d0d5215694636b5147ed0d216c047` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:55.185374 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce14e4-8464-4506-9c02-03dc5b8c3a42 None admin] RBAC: Authorizing `identity:create_grant(project_id=85323b48b377409bb1a44ca2c635e0c4, user_id=616f8d71ebce4404ad8cafca6f9eea78, role_id=5e1d0d5215694636b5147ed0d216c047)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:55.186876 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce14e4-8464-4506-9c02-03dc5b8c3a42 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:55.198080 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 147/289] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:03:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:55.204027 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb72582-7928-45fa-a4f4-03ad9e487446 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:55.207002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 143/290] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Sep 13 12:03:54 2022] PUT /identity/v3/projects/85323b48b377409bb1a44ca2c635e0c4/users/616f8d71ebce4404ad8cafca6f9eea78/roles/5e1d0d5215694636b5147ed0d216c047 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:03:55.326795 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb72582-7928-45fa-a4f4-03ad9e487446 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:55.367505 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f01b0-86a7-4a0d-b135-3aec8cae78a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:55.368068 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f01b0-86a7-4a0d-b135-3aec8cae78a9 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:55.368394 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f01b0-86a7-4a0d-b135-3aec8cae78a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:55.368672 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f01b0-86a7-4a0d-b135-3aec8cae78a9 None admin] PATH_INFO: `/v3/users/fd1d8b84d83841ef8b3f085749d21474` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:55.369835 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f01b0-86a7-4a0d-b135-3aec8cae78a9 None admin] RBAC: Authorizing `identity:get_user(user_id=fd1d8b84d83841ef8b3f085749d21474)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:55.371326 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f01b0-86a7-4a0d-b135-3aec8cae78a9 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:55.372921 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 148/291] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:55 2022] GET /identity/v3/users/fd1d8b84d83841ef8b3f085749d21474 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:55.378776 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce14e4-8464-4506-9c02-03dc5b8c3a42 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:55.463162 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:55.531383 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce14e4-8464-4506-9c02-03dc5b8c3a42 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:55.579630 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad7378-2dbd-4c82-b79c-dd568650cc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:55.580240 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad7378-2dbd-4c82-b79c-dd568650cc37 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:55.581060 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad7378-2dbd-4c82-b79c-dd568650cc37 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:55.581337 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad7378-2dbd-4c82-b79c-dd568650cc37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:55.691655 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad7378-2dbd-4c82-b79c-dd568650cc37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:55.694275 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad7378-2dbd-4c82-b79c-dd568650cc37 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:55.774385 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:55.822701 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 144/292] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:03:55.832586 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f01b0-86a7-4a0d-b135-3aec8cae78a9 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:55.836470 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:55.947648 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f01b0-86a7-4a0d-b135-3aec8cae78a9 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:55.996683 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70775a48-175d-460d-b918-9127abc80afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:55.997323 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70775a48-175d-460d-b918-9127abc80afe None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:55.997597 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70775a48-175d-460d-b918-9127abc80afe None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:55.997868 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70775a48-175d-460d-b918-9127abc80afe None admin] PATH_INFO: `/v3/projects/85323b48b377409bb1a44ca2c635e0c4` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:56.002919 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70775a48-175d-460d-b918-9127abc80afe None admin] RBAC: Authorizing `identity:get_project(project_id=85323b48b377409bb1a44ca2c635e0c4)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:56.004440 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70775a48-175d-460d-b918-9127abc80afe None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:56.006095 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 149/293] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:55 2022] GET /identity/v3/projects/85323b48b377409bb1a44ca2c635e0c4 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:56.012097 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad7378-2dbd-4c82-b79c-dd568650cc37 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:56.136106 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad7378-2dbd-4c82-b79c-dd568650cc37 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:56.192397 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661574ab-89d6-4b1d-8340-ea377acd17c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:56.193019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661574ab-89d6-4b1d-8340-ea377acd17c6 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:56.193304 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661574ab-89d6-4b1d-8340-ea377acd17c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:56.193580 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661574ab-89d6-4b1d-8340-ea377acd17c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:56.194327 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661574ab-89d6-4b1d-8340-ea377acd17c6 None admin] RBAC: Adding query filter params (role.id=ab14a68bf5b54561badd35b83e6acaf5, scope.project.id=85323b48b377409bb1a44ca2c635e0c4, user.id=fd1d8b84d83841ef8b3f085749d21474) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:56.194656 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661574ab-89d6-4b1d-8340-ea377acd17c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:56.196109 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661574ab-89d6-4b1d-8340-ea377acd17c6 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:56.203501 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 145/294] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:56 2022] GET /identity/v3/role_assignments?user.id=fd1d8b84d83841ef8b3f085749d21474&scope.project.id=85323b48b377409bb1a44ca2c635e0c4&role.id=ab14a68bf5b54561badd35b83e6acaf5 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:56.751192 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0275b68-c818-4006-ad4c-f6ae94aaaac8 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:56.751826 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0275b68-c818-4006-ad4c-f6ae94aaaac8 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:56.752330 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0275b68-c818-4006-ad4c-f6ae94aaaac8 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:56.753855 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 150/295] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:56.759369 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5e6b6-244a-4298-9739-717186786c11 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:56.759810 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5e6b6-244a-4298-9739-717186786c11 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:56.759901 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5e6b6-244a-4298-9739-717186786c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:56.780822 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-86e5e6b6-244a-4298-9739-717186786c11 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:56.782021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-86e5e6b6-244a-4298-9739-717186786c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:56.805255 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:56.864190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 146/296] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:56.945489 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2510cc3-88e4-44dc-8bae-ae310e71afab None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:56.946057 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2510cc3-88e4-44dc-8bae-ae310e71afab None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:56.946057 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2510cc3-88e4-44dc-8bae-ae310e71afab None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:56.947956 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 151/297] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:56.953720 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90878033-e0e8-4479-87eb-d587751b94fa None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:56.954002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90878033-e0e8-4479-87eb-d587751b94fa None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:56.954268 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90878033-e0e8-4479-87eb-d587751b94fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:56.976298 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-90878033-e0e8-4479-87eb-d587751b94fa None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:56.977492 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-90878033-e0e8-4479-87eb-d587751b94fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:56.996426 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cbc1f-1a41-492e-a659-676f7e522c87 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:56.996742 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cbc1f-1a41-492e-a659-676f7e522c87 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:56.996980 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cbc1f-1a41-492e-a659-676f7e522c87 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:56.998658 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 152/298] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:57.005981 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144f349-4ade-44e6-99ca-8797f2973d46 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:57.006544 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144f349-4ade-44e6-99ca-8797f2973d46 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:57.007093 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a144f349-4ade-44e6-99ca-8797f2973d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:57.026876 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-a144f349-4ade-44e6-99ca-8797f2973d46 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:57.028391 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-a144f349-4ade-44e6-99ca-8797f2973d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:57.064964 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 147/299] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:03:57.103995 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 153/300] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:03:57.225194 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90878033-e0e8-4479-87eb-d587751b94fa None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:57.314029 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:57.335196 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90878033-e0e8-4479-87eb-d587751b94fa None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:57.370041 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbebcc-df7c-4aa1-ae81-1247909c8af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:57.370773 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbebcc-df7c-4aa1-ae81-1247909c8af9 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:57.371059 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbebcc-df7c-4aa1-ae81-1247909c8af9 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:57.371332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbebcc-df7c-4aa1-ae81-1247909c8af9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:57.382396 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fbebcc-df7c-4aa1-ae81-1247909c8af9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:57.387355 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-73fbebcc-df7c-4aa1-ae81-1247909c8af9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:03:57.387355 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:57.387355 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:57.387355 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:57.387355 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:57.387355 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:57.387355 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:57.387355 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:57.387355 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:57.387355 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:57.387355 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:57.387355 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:57.387355 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:57.387355 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:57.387355 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:57.387355 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:57.388343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:57.388343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:57.388343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:57.388343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:57.388343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:57.388343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:57.388343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:57.388343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:57.388343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:57.388343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:57.388343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:57.388343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:57.388343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:57.388343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:57.388343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:57.388343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:57.389168 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:57.389168 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:57.389168 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:57.389168 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:57.389168 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:57.389168 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:57.389168 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:57.389168 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:57.389168 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:57.389168 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:57.389168 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:03:57.389168 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:03:57.389168 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 148/301] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:57.393505 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144f349-4ade-44e6-99ca-8797f2973d46 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:57.396433 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:57.397727 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbebcc-df7c-4aa1-ae81-1247909c8af9 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:57.513194 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a144f349-4ade-44e6-99ca-8797f2973d46 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:57.535088 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbebcc-df7c-4aa1-ae81-1247909c8af9 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:57.550839 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb64027-6424-4185-83f2-a42e0695a733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:57.551489 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb64027-6424-4185-83f2-a42e0695a733 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:57.551774 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb64027-6424-4185-83f2-a42e0695a733 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:57.552016 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb64027-6424-4185-83f2-a42e0695a733 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:57.562820 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb64027-6424-4185-83f2-a42e0695a733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:57.568522 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-4bb64027-6424-4185-83f2-a42e0695a733 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:03:57.568522 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:57.568522 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:57.568522 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:57.568522 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:57.568522 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:57.568522 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:57.568522 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:57.568522 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:57.568522 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:57.568522 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:57.568522 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:57.568522 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:57.568522 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:57.568522 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:57.568522 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:57.569409 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:57.569409 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:57.569409 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:57.569409 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:57.569409 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:57.569409 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:57.569409 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:57.569409 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:57.569409 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:57.569409 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:57.569409 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:57.569409 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:57.569409 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:57.569409 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:57.569409 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:57.569409 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:57.570196 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:57.570196 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:57.570196 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:57.570196 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:57.570196 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:57.570196 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:57.570196 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:57.570196 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:57.570196 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:57.570196 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:57.570196 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:03:57.570196 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:03:57.570196 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 154/302] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:57.570196 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb64027-6424-4185-83f2-a42e0695a733 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:57.578747 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6b53c-dce8-4f71-8799-8964b1e23fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:57.579574 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6b53c-dce8-4f71-8799-8964b1e23fb7 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:57.580020 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6b53c-dce8-4f71-8799-8964b1e23fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:57.580488 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6b53c-dce8-4f71-8799-8964b1e23fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:57.581612 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6b53c-dce8-4f71-8799-8964b1e23fb7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:57.582075 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6b53c-dce8-4f71-8799-8964b1e23fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:57.584056 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6b53c-dce8-4f71-8799-8964b1e23fb7 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:57.592991 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 149/303] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:03:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:03:57.593796 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6b53c-dce8-4f71-8799-8964b1e23fb7 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:57.596493 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:57.639202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:57.690761 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb64027-6424-4185-83f2-a42e0695a733 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:57.726299 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6b53c-dce8-4f71-8799-8964b1e23fb7 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:57.733635 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c44222-1992-415a-8cc9-bb4aa4a72e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:57.734262 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c44222-1992-415a-8cc9-bb4aa4a72e03 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:57.734545 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c44222-1992-415a-8cc9-bb4aa4a72e03 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:57.734859 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c44222-1992-415a-8cc9-bb4aa4a72e03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:57.735985 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c44222-1992-415a-8cc9-bb4aa4a72e03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:57.738061 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c44222-1992-415a-8cc9-bb4aa4a72e03 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:57.739738 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 155/304] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:03:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:57.740612 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c44222-1992-415a-8cc9-bb4aa4a72e03 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:57.769352 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56630907-3c5e-4711-8c0f-77063876ee88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:57.769879 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56630907-3c5e-4711-8c0f-77063876ee88 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:57.770185 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56630907-3c5e-4711-8c0f-77063876ee88 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:57.770407 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56630907-3c5e-4711-8c0f-77063876ee88 None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:57.771176 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56630907-3c5e-4711-8c0f-77063876ee88 None admin] RBAC: Adding query filter params (name=member) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:57.771426 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56630907-3c5e-4711-8c0f-77063876ee88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:57.772785 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56630907-3c5e-4711-8c0f-77063876ee88 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:57.782324 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 150/305] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:03:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:57.782972 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56630907-3c5e-4711-8c0f-77063876ee88 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:57.857180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:57.857567 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c44222-1992-415a-8cc9-bb4aa4a72e03 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:57.894294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:57.901262 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da068e-bd7f-4ef5-bc98-9f50d272c997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:57.901891 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da068e-bd7f-4ef5-bc98-9f50d272c997 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:57.902181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da068e-bd7f-4ef5-bc98-9f50d272c997 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:57.902473 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da068e-bd7f-4ef5-bc98-9f50d272c997 None admin] PATH_INFO: `/v3/users/2e114e59063a4d1da51f41cabd33c2ae` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:57.904666 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56630907-3c5e-4711-8c0f-77063876ee88 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:57.920135 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da068e-bd7f-4ef5-bc98-9f50d272c997 None admin] RBAC: Authorizing `identity:get_user(user_id=2e114e59063a4d1da51f41cabd33c2ae)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:57.921709 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da068e-bd7f-4ef5-bc98-9f50d272c997 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:57.923596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 156/306] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:57 2022] GET /identity/v3/users/2e114e59063a4d1da51f41cabd33c2ae => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:57.925131 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da068e-bd7f-4ef5-bc98-9f50d272c997 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:57.948718 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d25ac1-6fcb-41e5-9537-259e03ec3764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:57.949318 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d25ac1-6fcb-41e5-9537-259e03ec3764 None admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:57.949595 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d25ac1-6fcb-41e5-9537-259e03ec3764 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:57.949855 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d25ac1-6fcb-41e5-9537-259e03ec3764 None admin] PATH_INFO: `/v3/groups` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:57.950539 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d25ac1-6fcb-41e5-9537-259e03ec3764 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:57.952016 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d25ac1-6fcb-41e5-9537-259e03ec3764 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:57.978649 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 151/307] 10.222.0.15 () {60 vars in 1134 bytes} [Tue Sep 13 12:03:57 2022] POST /identity/v3/groups => generated 229 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:03:57.978649 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d25ac1-6fcb-41e5-9537-259e03ec3764 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:58.037254 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da068e-bd7f-4ef5-bc98-9f50d272c997 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:58.091756 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125db189-1fda-4265-8975-e8abdce57106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:58.092578 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125db189-1fda-4265-8975-e8abdce57106 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:58.092968 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125db189-1fda-4265-8975-e8abdce57106 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:58.093338 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125db189-1fda-4265-8975-e8abdce57106 None admin] PATH_INFO: `/v3/users/ca5b85d17a1b42dfa1e19f53e391f8c4` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:58.095294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125db189-1fda-4265-8975-e8abdce57106 None admin] RBAC: Authorizing `identity:get_user(user_id=ca5b85d17a1b42dfa1e19f53e391f8c4)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:58.098240 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125db189-1fda-4265-8975-e8abdce57106 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:58.100866 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 157/308] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:57 2022] GET /identity/v3/users/ca5b85d17a1b42dfa1e19f53e391f8c4 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:58.108300 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125db189-1fda-4265-8975-e8abdce57106 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:58.132533 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d25ac1-6fcb-41e5-9537-259e03ec3764 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:58.160919 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:58.176425 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a1f1b-5589-44ce-9563-e524f382f8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:58.177042 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a1f1b-5589-44ce-9563-e524f382f8b0 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:58.177319 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a1f1b-5589-44ce-9563-e524f382f8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:58.177596 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a1f1b-5589-44ce-9563-e524f382f8b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:58.178342 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a1f1b-5589-44ce-9563-e524f382f8b0 None admin] RBAC: Adding query filter params (role.id=5e1d0d5215694636b5147ed0d216c047, user.id=2e114e59063a4d1da51f41cabd33c2ae, scope.system=all) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:58.178683 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a1f1b-5589-44ce-9563-e524f382f8b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:58.180177 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a1f1b-5589-44ce-9563-e524f382f8b0 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:58.186041 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 152/309] 10.222.0.15 () {56 vars in 1308 bytes} [Tue Sep 13 12:03:57 2022] GET /identity/v3/role_assignments?user.id=2e114e59063a4d1da51f41cabd33c2ae&scope.system=all&role.id=5e1d0d5215694636b5147ed0d216c047 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:58.187149 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206a4e6-61ac-49e1-97f6-1fb200261a19 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:58.187431 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206a4e6-61ac-49e1-97f6-1fb200261a19 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:58.187706 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206a4e6-61ac-49e1-97f6-1fb200261a19 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:58.189199 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 153/310] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:03:58.195103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f25b49-0498-4dc3-afa4-e2e9ee622a35 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:58.195396 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f25b49-0498-4dc3-afa4-e2e9ee622a35 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:58.195675 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f25b49-0498-4dc3-afa4-e2e9ee622a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:58.199795 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:58.219956 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-c9f25b49-0498-4dc3-afa4-e2e9ee622a35 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:03:58.221860 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-c9f25b49-0498-4dc3-afa4-e2e9ee622a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:03:58.276606 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125db189-1fda-4265-8975-e8abdce57106 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:58.324882 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62d41b-d261-46a1-88f1-feae50639251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:58.325849 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62d41b-d261-46a1-88f1-feae50639251 None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:58.326131 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62d41b-d261-46a1-88f1-feae50639251 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:58.326523 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62d41b-d261-46a1-88f1-feae50639251 None admin] PATH_INFO: `/v3/system/users/ca5b85d17a1b42dfa1e19f53e391f8c4/roles/ab14a68bf5b54561badd35b83e6acaf5` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:58.328503 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62d41b-d261-46a1-88f1-feae50639251 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ca5b85d17a1b42dfa1e19f53e391f8c4, role_id=ab14a68bf5b54561badd35b83e6acaf5)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:58.328667 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 154/311] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:03:58.331005 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62d41b-d261-46a1-88f1-feae50639251 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:58.343000 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 158/312] 10.222.0.15 () {58 vars in 1334 bytes} [Tue Sep 13 12:03:58 2022] PUT /identity/v3/system/users/ca5b85d17a1b42dfa1e19f53e391f8c4/roles/ab14a68bf5b54561badd35b83e6acaf5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:03:58.684524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f25b49-0498-4dc3-afa4-e2e9ee622a35 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:58.801766 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f25b49-0498-4dc3-afa4-e2e9ee622a35 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:58.821179 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:58.842087 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b406b-7dc3-4cbe-abf2-82b4e6bd675a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:58.842796 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b406b-7dc3-4cbe-abf2-82b4e6bd675a None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:58.843100 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b406b-7dc3-4cbe-abf2-82b4e6bd675a None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:58.843368 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b406b-7dc3-4cbe-abf2-82b4e6bd675a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:58.854821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b406b-7dc3-4cbe-abf2-82b4e6bd675a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:03:58.860084 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-b45b406b-7dc3-4cbe-abf2-82b4e6bd675a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:03:58.860084 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:03:58.860084 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:03:58.860084 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:03:58.860084 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:03:58.860084 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:03:58.860084 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:03:58.860084 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:03:58.860084 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:03:58.860084 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:03:58.860084 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:03:58.860084 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:03:58.860084 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:03:58.860084 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:03:58.860084 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:03:58.860084 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:03:58.860986 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:03:58.860986 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:03:58.860986 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:03:58.860986 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:03:58.860986 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:03:58.860986 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:03:58.860986 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:03:58.860986 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:03:58.860986 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:03:58.860986 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:03:58.860986 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:03:58.860986 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:03:58.860986 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:03:58.860986 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:03:58.860986 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:03:58.860986 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:03:58.861804 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:03:58.861804 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:03:58.861804 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:03:58.861804 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:03:58.861804 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:03:58.861804 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:03:58.861804 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:03:58.861804 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:03:58.861804 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:03:58.861804 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:03:58.861804 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:03:58.861804 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:03:58.861804 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 155/313] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:03:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:03:58.868903 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62d41b-d261-46a1-88f1-feae50639251 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:58.989433 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62d41b-d261-46a1-88f1-feae50639251 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:59.011512 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:59.029266 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dc093-5d84-4d91-b429-f256dd22a1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:59.030228 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dc093-5d84-4d91-b429-f256dd22a1fe None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:59.030741 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dc093-5d84-4d91-b429-f256dd22a1fe None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:59.031215 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dc093-5d84-4d91-b429-f256dd22a1fe None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:59.032095 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280dc093-5d84-4d91-b429-f256dd22a1fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:59.032600 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280dc093-5d84-4d91-b429-f256dd22a1fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:59.034527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280dc093-5d84-4d91-b429-f256dd22a1fe None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:59.044377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 159/314] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:03:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:59.054739 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b406b-7dc3-4cbe-abf2-82b4e6bd675a None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:59.173066 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b406b-7dc3-4cbe-abf2-82b4e6bd675a None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:59.209763 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77faa21c-13e4-4753-9bc4-e337ccc1028a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:59.210448 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77faa21c-13e4-4753-9bc4-e337ccc1028a None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:59.210797 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77faa21c-13e4-4753-9bc4-e337ccc1028a None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:59.211111 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77faa21c-13e4-4753-9bc4-e337ccc1028a None admin] PATH_INFO: `/v3/users/616f8d71ebce4404ad8cafca6f9eea78` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:59.212476 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77faa21c-13e4-4753-9bc4-e337ccc1028a None admin] RBAC: Authorizing `identity:get_user(user_id=616f8d71ebce4404ad8cafca6f9eea78)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:59.214088 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77faa21c-13e4-4753-9bc4-e337ccc1028a None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:59.216272 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 156/315] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:03:59 2022] GET /identity/v3/users/616f8d71ebce4404ad8cafca6f9eea78 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:59.223008 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dc093-5d84-4d91-b429-f256dd22a1fe None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:59.344634 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dc093-5d84-4d91-b429-f256dd22a1fe None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:59.381493 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9755ea-8dca-4f3a-a56d-cf5982687531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:59.382461 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9755ea-8dca-4f3a-a56d-cf5982687531 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:59.382975 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9755ea-8dca-4f3a-a56d-cf5982687531 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:59.383461 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9755ea-8dca-4f3a-a56d-cf5982687531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:59.440738 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:59.469584 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9755ea-8dca-4f3a-a56d-cf5982687531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:59.471276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9755ea-8dca-4f3a-a56d-cf5982687531 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:59.587186 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 160/316] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:03:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:03:59.593040 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77faa21c-13e4-4753-9bc4-e337ccc1028a None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:59.646829 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:59.703633 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77faa21c-13e4-4753-9bc4-e337ccc1028a None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:59.740227 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0a476-f2a5-4a4b-9066-46f7040b8a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:59.740850 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0a476-f2a5-4a4b-9066-46f7040b8a28 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:59.741168 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0a476-f2a5-4a4b-9066-46f7040b8a28 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:59.741441 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0a476-f2a5-4a4b-9066-46f7040b8a28 None admin] PATH_INFO: `/v3/projects/85323b48b377409bb1a44ca2c635e0c4` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:59.742637 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0a476-f2a5-4a4b-9066-46f7040b8a28 None admin] RBAC: Authorizing `identity:get_project(project_id=85323b48b377409bb1a44ca2c635e0c4)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:59.744061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0a476-f2a5-4a4b-9066-46f7040b8a28 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:59.746032 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 157/317] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:03:59 2022] GET /identity/v3/projects/85323b48b377409bb1a44ca2c635e0c4 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:03:59.752146 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9755ea-8dca-4f3a-a56d-cf5982687531 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:03:59.842198 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:03:59.870509 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9755ea-8dca-4f3a-a56d-cf5982687531 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:03:59.911029 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec727bb-9601-4c5e-aade-565d8eb1ce37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:03:59.911910 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec727bb-9601-4c5e-aade-565d8eb1ce37 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:03:59.912205 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec727bb-9601-4c5e-aade-565d8eb1ce37 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:03:59.912483 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec727bb-9601-4c5e-aade-565d8eb1ce37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:03:59.913442 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec727bb-9601-4c5e-aade-565d8eb1ce37 None admin] RBAC: Adding query filter params (role.id=5e1d0d5215694636b5147ed0d216c047, scope.project.id=85323b48b377409bb1a44ca2c635e0c4, user.id=616f8d71ebce4404ad8cafca6f9eea78) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:03:59.913756 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec727bb-9601-4c5e-aade-565d8eb1ce37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:03:59.915597 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec727bb-9601-4c5e-aade-565d8eb1ce37 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:03:59.922766 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 161/318] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:03:59 2022] GET /identity/v3/role_assignments?user.id=616f8d71ebce4404ad8cafca6f9eea78&scope.project.id=85323b48b377409bb1a44ca2c635e0c4&role.id=5e1d0d5215694636b5147ed0d216c047 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:00.639863 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890d376-a108-4fe9-b517-6ac3f851bcda None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:00.640378 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890d376-a108-4fe9-b517-6ac3f851bcda None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:00.640643 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890d376-a108-4fe9-b517-6ac3f851bcda None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:00.642062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 158/319] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:00.647998 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e644102-5513-420f-8cf1-833b1d4150e6 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:00.648430 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e644102-5513-420f-8cf1-833b1d4150e6 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:00.648605 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e644102-5513-420f-8cf1-833b1d4150e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:00.668697 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-8e644102-5513-420f-8cf1-833b1d4150e6 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:00.669890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-8e644102-5513-420f-8cf1-833b1d4150e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:00.740497 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 162/320] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:00.876305 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de096e1-e04b-478a-852f-625fd748fa31 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:00.876584 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de096e1-e04b-478a-852f-625fd748fa31 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:00.877077 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de096e1-e04b-478a-852f-625fd748fa31 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:00.879236 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 159/321] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:00.884658 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921301a-9c38-4a03-b176-ca10e26cfe63 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:00.884952 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921301a-9c38-4a03-b176-ca10e26cfe63 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:00.885229 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921301a-9c38-4a03-b176-ca10e26cfe63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:00.893853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f39b5-6dc0-4776-9e66-4e64b3df4890 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:00.894018 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f39b5-6dc0-4776-9e66-4e64b3df4890 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:00.894290 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f39b5-6dc0-4776-9e66-4e64b3df4890 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:00.895963 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 160/322] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:04:00.901007 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f010405-52fb-4b96-bcc2-fc9bbbf89c66 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:00.901285 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f010405-52fb-4b96-bcc2-fc9bbbf89c66 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:00.901556 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f010405-52fb-4b96-bcc2-fc9bbbf89c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:00.904613 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-f921301a-9c38-4a03-b176-ca10e26cfe63 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:00.905894 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-f921301a-9c38-4a03-b176-ca10e26cfe63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:00.921571 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-2f010405-52fb-4b96-bcc2-fc9bbbf89c66 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:00.923572 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-2f010405-52fb-4b96-bcc2-fc9bbbf89c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:00.983210 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 163/323] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:01.003345 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 161/324] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:04:01.060897 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921301a-9c38-4a03-b176-ca10e26cfe63 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:01.071832 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:01.166105 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921301a-9c38-4a03-b176-ca10e26cfe63 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:01.201158 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b9d26-9341-4786-a1c9-41cb9bf0c1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:01.201781 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b9d26-9341-4786-a1c9-41cb9bf0c1ef None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:01.202054 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b9d26-9341-4786-a1c9-41cb9bf0c1ef None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:01.202320 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b9d26-9341-4786-a1c9-41cb9bf0c1ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:01.203451 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b9d26-9341-4786-a1c9-41cb9bf0c1ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:01.204908 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b9d26-9341-4786-a1c9-41cb9bf0c1ef None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:01.206923 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 164/325] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:01.212270 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f010405-52fb-4b96-bcc2-fc9bbbf89c66 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:01.260253 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:01.317792 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b9d26-9341-4786-a1c9-41cb9bf0c1ef None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:01.321190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f010405-52fb-4b96-bcc2-fc9bbbf89c66 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:01.358626 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6722f-d802-4851-b06d-646dba37e610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:01.359259 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6722f-d802-4851-b06d-646dba37e610 None admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:01.359532 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6722f-d802-4851-b06d-646dba37e610 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:01.359800 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6722f-d802-4851-b06d-646dba37e610 None admin] PATH_INFO: `/v3/groups` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:01.360436 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6722f-d802-4851-b06d-646dba37e610 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:01.361946 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6722f-d802-4851-b06d-646dba37e610 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:01.377964 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 162/326] 10.222.0.15 () {60 vars in 1134 bytes} [Tue Sep 13 12:04:01 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:04:01.378921 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6722f-d802-4851-b06d-646dba37e610 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:01.407547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:01.448418 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b9d26-9341-4786-a1c9-41cb9bf0c1ef None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:01.492712 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194ecc8-2992-4f85-99ae-42c1ffcb4289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:01.493663 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194ecc8-2992-4f85-99ae-42c1ffcb4289 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:01.493943 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194ecc8-2992-4f85-99ae-42c1ffcb4289 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:01.494215 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194ecc8-2992-4f85-99ae-42c1ffcb4289 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:01.513468 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194ecc8-2992-4f85-99ae-42c1ffcb4289 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:01.515414 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6722f-d802-4851-b06d-646dba37e610 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:01.520081 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-4194ecc8-2992-4f85-99ae-42c1ffcb4289 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:04:01.520081 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:01.520081 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:01.520081 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:01.520081 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:01.520081 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:01.520081 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:01.520081 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:01.520081 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:01.520081 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:01.520081 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:01.520081 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:01.520081 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:01.520081 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:01.520081 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:01.520081 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:01.521011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:01.521011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:01.521011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:01.521011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:01.521011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:01.521011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:01.521011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:01.521011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:01.521011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:01.521011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:01.521011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:01.521011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:01.521011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:01.521011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:01.521011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:01.521011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:01.521825 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:01.521825 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:01.521825 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:01.521825 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:01.521825 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:01.521825 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:01.521825 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:01.521825 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:01.521825 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:01.521825 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:01.521825 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:04:01.521825 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:01.522430 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:01.522498 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 165/327] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:04:01.527740 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194ecc8-2992-4f85-99ae-42c1ffcb4289 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:01.568251 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd802cc7-3f09-436e-9557-a62a05a53bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:01.568896 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd802cc7-3f09-436e-9557-a62a05a53bd0 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:01.569178 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd802cc7-3f09-436e-9557-a62a05a53bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:01.569444 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd802cc7-3f09-436e-9557-a62a05a53bd0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:01.582893 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd802cc7-3f09-436e-9557-a62a05a53bd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:01.587954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-dd802cc7-3f09-436e-9557-a62a05a53bd0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:04:01.587954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:01.587954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:01.587954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:01.587954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:01.587954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:01.587954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:01.587954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:01.587954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:01.587954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:01.587954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:01.587954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:01.587954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:01.587954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:01.587954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:01.587954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:01.588919 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:01.588919 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:01.588919 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:01.588919 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:01.588919 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:01.588919 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:01.588919 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:01.588919 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:01.588919 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:01.588919 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:01.588919 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:01.588919 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:01.588919 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:01.588919 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:01.588919 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:01.588919 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:01.589704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:01.589704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:01.589704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:01.589704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:01.589704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:01.589704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:01.589704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:01.589704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:01.589704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:01.589704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:01.589704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:04:01.589704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:01.589704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 163/328] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:01.595124 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd802cc7-3f09-436e-9557-a62a05a53bd0 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:01.683197 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194ecc8-2992-4f85-99ae-42c1ffcb4289 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:01.725523 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd802cc7-3f09-436e-9557-a62a05a53bd0 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:01.737352 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a5b0c-e19f-404f-9c81-f7fb30254bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:01.738469 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a5b0c-e19f-404f-9c81-f7fb30254bd7 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:01.738841 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a5b0c-e19f-404f-9c81-f7fb30254bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:01.739116 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a5b0c-e19f-404f-9c81-f7fb30254bd7 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:01.740284 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a5b0c-e19f-404f-9c81-f7fb30254bd7 None admin] RBAC: Adding query filter params (name=member) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:01.740748 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a5b0c-e19f-404f-9c81-f7fb30254bd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:01.742388 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a5b0c-e19f-404f-9c81-f7fb30254bd7 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:01.750974 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:01.754710 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 166/329] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:04:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:01.760749 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a5b0c-e19f-404f-9c81-f7fb30254bd7 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:01.771373 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d35c2-3caf-483a-8046-7f0f582f17c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:01.772594 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d35c2-3caf-483a-8046-7f0f582f17c0 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:01.772879 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d35c2-3caf-483a-8046-7f0f582f17c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:01.773151 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d35c2-3caf-483a-8046-7f0f582f17c0 None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:01.773839 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d35c2-3caf-483a-8046-7f0f582f17c0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:01.774148 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d35c2-3caf-483a-8046-7f0f582f17c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:01.776111 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d35c2-3caf-483a-8046-7f0f582f17c0 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:01.791595 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 164/330] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:04:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:01.797414 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d35c2-3caf-483a-8046-7f0f582f17c0 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:01.839911 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:01.912691 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a5b0c-e19f-404f-9c81-f7fb30254bd7 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:01.935568 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d35c2-3caf-483a-8046-7f0f582f17c0 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:01.948978 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a9c35-47d8-41a7-9abe-b408f1b55cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:01.949733 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a9c35-47d8-41a7-9abe-b408f1b55cb5 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:01.950080 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a9c35-47d8-41a7-9abe-b408f1b55cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:01.950421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a9c35-47d8-41a7-9abe-b408f1b55cb5 None admin] PATH_INFO: `/v3/users/ca5b85d17a1b42dfa1e19f53e391f8c4` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:01.951668 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a9c35-47d8-41a7-9abe-b408f1b55cb5 None admin] RBAC: Authorizing `identity:get_user(user_id=ca5b85d17a1b42dfa1e19f53e391f8c4)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:01.953183 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a9c35-47d8-41a7-9abe-b408f1b55cb5 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:01.954884 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 167/331] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:04:01 2022] GET /identity/v3/users/ca5b85d17a1b42dfa1e19f53e391f8c4 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:01.960637 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a9c35-47d8-41a7-9abe-b408f1b55cb5 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:01.988016 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1d04a-de8f-45fb-a0e3-f070ce86f8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:01.989014 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1d04a-de8f-45fb-a0e3-f070ce86f8b2 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:01.989505 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1d04a-de8f-45fb-a0e3-f070ce86f8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:01.989977 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1d04a-de8f-45fb-a0e3-f070ce86f8b2 None admin] PATH_INFO: `/v3/users/2e114e59063a4d1da51f41cabd33c2ae` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:01.991523 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1d04a-de8f-45fb-a0e3-f070ce86f8b2 None admin] RBAC: Authorizing `identity:get_user(user_id=2e114e59063a4d1da51f41cabd33c2ae)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:01.993370 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1d04a-de8f-45fb-a0e3-f070ce86f8b2 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:01.995633 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 165/332] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:04:01 2022] GET /identity/v3/users/2e114e59063a4d1da51f41cabd33c2ae => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:02.003863 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1d04a-de8f-45fb-a0e3-f070ce86f8b2 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:02.046061 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:02.096439 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a9c35-47d8-41a7-9abe-b408f1b55cb5 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:02.136085 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde84119-7795-441c-88c8-3b0ac4f888dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:02.136764 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde84119-7795-441c-88c8-3b0ac4f888dd None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:02.137044 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde84119-7795-441c-88c8-3b0ac4f888dd None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:02.137318 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde84119-7795-441c-88c8-3b0ac4f888dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:02.138091 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde84119-7795-441c-88c8-3b0ac4f888dd None admin] RBAC: Adding query filter params (role.id=ab14a68bf5b54561badd35b83e6acaf5, user.id=ca5b85d17a1b42dfa1e19f53e391f8c4, scope.system=all) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:02.138401 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde84119-7795-441c-88c8-3b0ac4f888dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:02.139526 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:02.140146 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde84119-7795-441c-88c8-3b0ac4f888dd None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:02.152327 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1d04a-de8f-45fb-a0e3-f070ce86f8b2 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:02.160943 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 168/333] 10.222.0.15 () {56 vars in 1308 bytes} [Tue Sep 13 12:04:01 2022] GET /identity/v3/role_assignments?user.id=ca5b85d17a1b42dfa1e19f53e391f8c4&scope.system=all&role.id=ab14a68bf5b54561badd35b83e6acaf5 => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:02.197007 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49720282-194e-4042-a578-8ff4ea1a5f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:02.197687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49720282-194e-4042-a578-8ff4ea1a5f20 None admin] REQUEST_METHOD: `PUT` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:02.197968 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49720282-194e-4042-a578-8ff4ea1a5f20 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:02.198245 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49720282-194e-4042-a578-8ff4ea1a5f20 None admin] PATH_INFO: `/v3/system/users/2e114e59063a4d1da51f41cabd33c2ae/roles/5e1d0d5215694636b5147ed0d216c047` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:02.199934 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49720282-194e-4042-a578-8ff4ea1a5f20 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2e114e59063a4d1da51f41cabd33c2ae, role_id=5e1d0d5215694636b5147ed0d216c047)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:02.201377 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49720282-194e-4042-a578-8ff4ea1a5f20 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:02.212951 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 166/334] 10.222.0.15 () {58 vars in 1334 bytes} [Tue Sep 13 12:04:02 2022] PUT /identity/v3/system/users/2e114e59063a4d1da51f41cabd33c2ae/roles/5e1d0d5215694636b5147ed0d216c047 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:04:04.568936 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafdec5-dfe5-485e-8543-3a447e644a3d None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:04.569612 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafdec5-dfe5-485e-8543-3a447e644a3d None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:04.569612 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafdec5-dfe5-485e-8543-3a447e644a3d None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:04.571117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 169/335] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:04.588744 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23e9fa-60fa-4824-8d9e-717abbfc20d4 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:04.589335 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23e9fa-60fa-4824-8d9e-717abbfc20d4 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:04.589335 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23e9fa-60fa-4824-8d9e-717abbfc20d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:04.613964 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-0e23e9fa-60fa-4824-8d9e-717abbfc20d4 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:04.615346 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-0e23e9fa-60fa-4824-8d9e-717abbfc20d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:04.710430 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 167/336] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:04.744728 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d1a80-3e0f-452f-83f7-d325fa0e7f54 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:04.745018 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d1a80-3e0f-452f-83f7-d325fa0e7f54 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:04.745278 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d1a80-3e0f-452f-83f7-d325fa0e7f54 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:04.746734 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 170/337] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:04.752976 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2119f0-1c1c-41df-a301-0217c6f27df3 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:04.753479 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2119f0-1c1c-41df-a301-0217c6f27df3 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:04.753672 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2119f0-1c1c-41df-a301-0217c6f27df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:04.777102 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-4d2119f0-1c1c-41df-a301-0217c6f27df3 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:04.778323 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-4d2119f0-1c1c-41df-a301-0217c6f27df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:04.865311 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 168/338] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:05.423659 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2577e-81da-4ecc-8f9d-ffba2a224f13 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:05.424421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2577e-81da-4ecc-8f9d-ffba2a224f13 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:05.424909 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2577e-81da-4ecc-8f9d-ffba2a224f13 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:05.426756 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 171/339] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:05.432101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1b73c-2d84-4c8e-adbc-fa3ee4799405 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:05.432381 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1b73c-2d84-4c8e-adbc-fa3ee4799405 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:05.432659 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1b73c-2d84-4c8e-adbc-fa3ee4799405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:05.435235 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2577e-81da-4ecc-8f9d-ffba2a224f13 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:05.461965 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-24f1b73c-2d84-4c8e-adbc-fa3ee4799405 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:05.468231 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-24f1b73c-2d84-4c8e-adbc-fa3ee4799405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:05.490410 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:05.590968 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 169/340] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:05.591841 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1b73c-2d84-4c8e-adbc-fa3ee4799405 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:05.675715 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2577e-81da-4ecc-8f9d-ffba2a224f13 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:05.720464 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:05.747797 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca039b1e-855e-4275-b400-f6af28e89486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:05.748709 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca039b1e-855e-4275-b400-f6af28e89486 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:05.749113 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca039b1e-855e-4275-b400-f6af28e89486 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:05.749504 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca039b1e-855e-4275-b400-f6af28e89486 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:05.778115 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca039b1e-855e-4275-b400-f6af28e89486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:05.786157 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-ca039b1e-855e-4275-b400-f6af28e89486 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:04:05.786157 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:05.786157 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:05.786157 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:05.786157 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:05.786157 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:05.786157 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:05.786157 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:05.786157 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:05.786157 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:05.786157 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:05.786157 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:05.786157 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:05.786157 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:05.786157 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:05.786157 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:05.787106 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:05.787106 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:05.787106 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:05.787106 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:05.787106 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:05.787106 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:05.787106 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:05.787106 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:05.787106 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:05.787106 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:05.787106 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:05.787106 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:05.787106 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:05.787106 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:05.787106 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:05.787106 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:05.787890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:05.787890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:05.787890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:05.787890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:05.787890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:05.787890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:05.787890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:05.787890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:05.787890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:05.787890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:05.787890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:04:05.787890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:05.792416 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 172/341] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Sep 13 12:04:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:04:05.797690 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a302f3-4bd2-4fbb-b311-ff35798dd1fb None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:05.798107 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a302f3-4bd2-4fbb-b311-ff35798dd1fb None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:05.798516 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a302f3-4bd2-4fbb-b311-ff35798dd1fb None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:05.801464 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 173/342] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:04:05.807474 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb467799-c4e6-4fb4-940d-a80ad9965d55 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:05.808125 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb467799-c4e6-4fb4-940d-a80ad9965d55 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:05.808716 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb467799-c4e6-4fb4-940d-a80ad9965d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:05.844721 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1b73c-2d84-4c8e-adbc-fa3ee4799405 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:05.862553 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-bb467799-c4e6-4fb4-940d-a80ad9965d55 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:05.864148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-bb467799-c4e6-4fb4-940d-a80ad9965d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:05.934196 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1b90b-d172-4c6b-8d3e-f9361c39e08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:05.935013 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1b90b-d172-4c6b-8d3e-f9361c39e08b None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:05.935132 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1b90b-d172-4c6b-8d3e-f9361c39e08b None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:05.935358 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1b90b-d172-4c6b-8d3e-f9361c39e08b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:05.966421 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1b90b-d172-4c6b-8d3e-f9361c39e08b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:05.968061 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 174/343] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:05.969117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb467799-c4e6-4fb4-940d-a80ad9965d55 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:05.971817 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-c4f1b90b-d172-4c6b-8d3e-f9361c39e08b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:04:05.971817 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:05.971817 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:05.971817 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:05.971817 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:05.971817 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:05.971817 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:05.971817 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:05.971817 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:05.971817 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:05.971817 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:05.971817 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:05.971817 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:05.971817 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:05.971817 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:05.971817 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:05.972935 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:05.972935 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:05.972935 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:05.972935 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:05.972935 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:05.972935 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:05.972935 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:05.972935 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:05.972935 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:05.972935 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:05.972935 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:05.972935 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:05.972935 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:05.972935 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:05.972935 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:05.972935 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:05.973867 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:05.973867 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:05.973867 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:05.973867 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:05.973867 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:05.973867 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:05.973867 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:05.973867 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:05.973867 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:05.973867 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:05.973867 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:04:05.973867 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:05.973867 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 170/344] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:05.979092 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1b90b-d172-4c6b-8d3e-f9361c39e08b None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:05.994757 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:06.149809 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb467799-c4e6-4fb4-940d-a80ad9965d55 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:06.187098 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:06.210050 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1b90b-d172-4c6b-8d3e-f9361c39e08b None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:06.240958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59cdd6-a641-4079-9b1d-3affca01d494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:06.241831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59cdd6-a641-4079-9b1d-3affca01d494 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:06.242262 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59cdd6-a641-4079-9b1d-3affca01d494 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:06.242727 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59cdd6-a641-4079-9b1d-3affca01d494 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:06.243534 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59cdd6-a641-4079-9b1d-3affca01d494 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:06.243996 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59cdd6-a641-4079-9b1d-3affca01d494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:06.246589 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59cdd6-a641-4079-9b1d-3affca01d494 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:06.266156 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 175/345] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:06.267584 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59cdd6-a641-4079-9b1d-3affca01d494 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:06.268729 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9deffb8-b6e0-4e1e-af0e-7d638cc54489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:06.272034 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9deffb8-b6e0-4e1e-af0e-7d638cc54489 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:06.273338 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9deffb8-b6e0-4e1e-af0e-7d638cc54489 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:06.273826 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9deffb8-b6e0-4e1e-af0e-7d638cc54489 None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:06.274722 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9deffb8-b6e0-4e1e-af0e-7d638cc54489 None admin] RBAC: Adding query filter params (name=member) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:06.275424 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9deffb8-b6e0-4e1e-af0e-7d638cc54489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:06.277009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9deffb8-b6e0-4e1e-af0e-7d638cc54489 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:06.288526 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 171/346] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:04:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:06.289698 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9deffb8-b6e0-4e1e-af0e-7d638cc54489 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:06.417445 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:06.453263 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9deffb8-b6e0-4e1e-af0e-7d638cc54489 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:06.467134 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59cdd6-a641-4079-9b1d-3affca01d494 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:06.500070 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1b826-76fa-4f2c-a494-44d03f6a3a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:06.500946 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1b826-76fa-4f2c-a494-44d03f6a3a76 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:06.501226 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1b826-76fa-4f2c-a494-44d03f6a3a76 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:06.501499 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1b826-76fa-4f2c-a494-44d03f6a3a76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:06.520562 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a712977-6286-4c64-8f0f-0428bc2f7091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:06.521204 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a712977-6286-4c64-8f0f-0428bc2f7091 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:06.521476 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a712977-6286-4c64-8f0f-0428bc2f7091 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:06.521743 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a712977-6286-4c64-8f0f-0428bc2f7091 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:06.540734 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a712977-6286-4c64-8f0f-0428bc2f7091 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:06.547596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-0a712977-6286-4c64-8f0f-0428bc2f7091 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:04:06.547596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:06.547596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:06.547596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:06.547596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:06.547596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:06.547596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:06.547596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:06.547596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:06.547596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:06.547596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:06.547596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:06.547596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:06.547596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:06.547596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:06.547596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:06.548571 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:06.548571 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:06.548571 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:06.548571 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:06.548571 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:06.548571 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:06.548571 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:06.548571 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:06.548571 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:06.548571 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:06.548571 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:06.548571 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:06.548571 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:06.548571 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:06.548571 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:06.548571 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:06.550782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:06.550782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:06.550782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:06.550782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:06.550782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:06.550782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:06.550782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:06.550782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:06.550782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:06.550782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:06.550782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 12:04:06.550782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:06.550782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 176/347] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:06.550782 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a712977-6286-4c64-8f0f-0428bc2f7091 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:06.598053 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:06.617164 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1b826-76fa-4f2c-a494-44d03f6a3a76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:06.618995 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1b826-76fa-4f2c-a494-44d03f6a3a76 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:06.701337 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a712977-6286-4c64-8f0f-0428bc2f7091 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:06.729347 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:06.769042 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdb387-eaf5-4d31-803b-f78344ae0030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:06.769569 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdb387-eaf5-4d31-803b-f78344ae0030 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:06.769849 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdb387-eaf5-4d31-803b-f78344ae0030 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:06.770565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdb387-eaf5-4d31-803b-f78344ae0030 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:06.778742 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 172/348] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:04:06.784264 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff506e-5774-487e-b461-930a7ce153f5 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:06.784264 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff506e-5774-487e-b461-930a7ce153f5 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:06.784264 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff506e-5774-487e-b461-930a7ce153f5 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:06.784264 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 173/349] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:06.784648 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff506e-5774-487e-b461-930a7ce153f5 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:06.879948 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdb387-eaf5-4d31-803b-f78344ae0030 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:06.881546 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdb387-eaf5-4d31-803b-f78344ae0030 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:06.928023 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:06.930554 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff506e-5774-487e-b461-930a7ce153f5 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:06.991630 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320de28-8751-4453-95db-057858fe39c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:06.991630 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320de28-8751-4453-95db-057858fe39c9 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:06.991630 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320de28-8751-4453-95db-057858fe39c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:06.991946 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320de28-8751-4453-95db-057858fe39c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:07.005115 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320de28-8751-4453-95db-057858fe39c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:07.010483 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-3320de28-8751-4453-95db-057858fe39c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:04:07.010483 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:07.010483 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:07.010483 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:07.010483 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:07.010483 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:07.010483 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:07.010483 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:07.010483 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:07.010483 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:07.010483 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:07.010483 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:07.010483 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:07.010483 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:07.010483 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:07.010483 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:07.011378 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:07.011378 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:07.011378 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:07.011378 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:07.011378 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:07.011378 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:07.011378 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:07.011378 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:07.011378 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:07.011378 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:07.011378 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:07.011378 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:07.011378 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:07.011378 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:07.011378 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:07.011378 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:07.012180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:07.012180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:07.012180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:07.012180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:07.012180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:07.012180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:07.012180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:07.012180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:07.012180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:07.012180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:07.012180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:04:07.012180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:07.012180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 174/350] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:07.012832 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320de28-8751-4453-95db-057858fe39c9 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:07.028381 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 177/351] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:04:07.029548 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdb387-eaf5-4d31-803b-f78344ae0030 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:07.057037 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:07.155819 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdb387-eaf5-4d31-803b-f78344ae0030 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:07.156014 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320de28-8751-4453-95db-057858fe39c9 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:07.204233 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27bf2a-7145-4f3d-b0b1-1d899a0db450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:07.204874 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27bf2a-7145-4f3d-b0b1-1d899a0db450 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:07.205991 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27bf2a-7145-4f3d-b0b1-1d899a0db450 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:07.206366 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27bf2a-7145-4f3d-b0b1-1d899a0db450 None admin] PATH_INFO: `/v3/projects/b8c35869b0184f978d0e9bb42b22ad27` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:07.208764 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27bf2a-7145-4f3d-b0b1-1d899a0db450 None admin] RBAC: Authorizing `identity:get_project(project_id=b8c35869b0184f978d0e9bb42b22ad27)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:07.209048 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27bf2a-7145-4f3d-b0b1-1d899a0db450 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:07.217332 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 178/352] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:07 2022] GET /identity/v3/projects/b8c35869b0184f978d0e9bb42b22ad27 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:07.217332 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21857a23-404b-46af-8dce-c4ae76918789 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:07.217332 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21857a23-404b-46af-8dce-c4ae76918789 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:07.217332 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21857a23-404b-46af-8dce-c4ae76918789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:07.221522 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a83bb-5d11-41f1-809d-cf7e8449582a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:07.222300 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a83bb-5d11-41f1-809d-cf7e8449582a None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:07.223169 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a83bb-5d11-41f1-809d-cf7e8449582a None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:07.223169 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a83bb-5d11-41f1-809d-cf7e8449582a None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:07.223409 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a83bb-5d11-41f1-809d-cf7e8449582a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:07.223855 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:07.223964 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a83bb-5d11-41f1-809d-cf7e8449582a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:07.226298 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a83bb-5d11-41f1-809d-cf7e8449582a None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:07.237686 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 175/353] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:04:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:07.238531 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a83bb-5d11-41f1-809d-cf7e8449582a None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:07.239985 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-21857a23-404b-46af-8dce-c4ae76918789 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:07.242156 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-21857a23-404b-46af-8dce-c4ae76918789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:07.338099 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 179/354] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:07.338099 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21857a23-404b-46af-8dce-c4ae76918789 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:07.374645 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:07.389628 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a83bb-5d11-41f1-809d-cf7e8449582a None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:07.435796 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4976f5-2ec0-4d0e-99eb-ceeb5983fe8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:07.436775 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4976f5-2ec0-4d0e-99eb-ceeb5983fe8f None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:07.436775 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4976f5-2ec0-4d0e-99eb-ceeb5983fe8f None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:07.436775 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4976f5-2ec0-4d0e-99eb-ceeb5983fe8f None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:07.437373 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4976f5-2ec0-4d0e-99eb-ceeb5983fe8f None admin] RBAC: Adding query filter params (name=member) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:07.437685 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4976f5-2ec0-4d0e-99eb-ceeb5983fe8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:07.440369 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4976f5-2ec0-4d0e-99eb-ceeb5983fe8f None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:07.449946 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 176/355] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:04:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:07.452662 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4976f5-2ec0-4d0e-99eb-ceeb5983fe8f None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:07.480982 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21857a23-404b-46af-8dce-c4ae76918789 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:07.525271 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:07.531891 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca364d26-acc4-4644-a0f1-a5c713bf3a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:07.532538 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca364d26-acc4-4644-a0f1-a5c713bf3a2d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:07.532818 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca364d26-acc4-4644-a0f1-a5c713bf3a2d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:07.533760 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca364d26-acc4-4644-a0f1-a5c713bf3a2d None admin] PATH_INFO: `/v3/projects/b8c35869b0184f978d0e9bb42b22ad27` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:07.536982 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca364d26-acc4-4644-a0f1-a5c713bf3a2d None admin] RBAC: Authorizing `identity:get_project(project_id=b8c35869b0184f978d0e9bb42b22ad27)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:07.536982 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca364d26-acc4-4644-a0f1-a5c713bf3a2d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:07.541953 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 180/356] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:07 2022] GET /identity/v3/projects/b8c35869b0184f978d0e9bb42b22ad27 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:07.541953 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca364d26-acc4-4644-a0f1-a5c713bf3a2d None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:07.591482 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4976f5-2ec0-4d0e-99eb-ceeb5983fe8f None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:07.632646 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea29329-e8de-4796-95e7-51f368e9ee9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:07.634033 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea29329-e8de-4796-95e7-51f368e9ee9d None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:07.634525 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea29329-e8de-4796-95e7-51f368e9ee9d None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:07.635015 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea29329-e8de-4796-95e7-51f368e9ee9d None admin] PATH_INFO: `/v3/groups/c835dd1157c847beba445175d736aeec` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:07.643379 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea29329-e8de-4796-95e7-51f368e9ee9d None admin] RBAC: Authorizing `identity:get_group(group_id=c835dd1157c847beba445175d736aeec)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:07.645763 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea29329-e8de-4796-95e7-51f368e9ee9d None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:07.648133 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 177/357] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Sep 13 12:04:07 2022] GET /identity/v3/groups/c835dd1157c847beba445175d736aeec => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:07.649519 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef317dee-65bf-4e67-adf0-dd64f10a119f None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:07.650004 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef317dee-65bf-4e67-adf0-dd64f10a119f None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:07.650467 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef317dee-65bf-4e67-adf0-dd64f10a119f None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:07.652143 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 178/358] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:07.653647 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef317dee-65bf-4e67-adf0-dd64f10a119f None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:07.676820 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca364d26-acc4-4644-a0f1-a5c713bf3a2d None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:07.680931 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:07.723403 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5421b-909d-457a-b2c0-b4137e60cace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:07.724084 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5421b-909d-457a-b2c0-b4137e60cace None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:07.724362 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5421b-909d-457a-b2c0-b4137e60cace None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:07.724631 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5421b-909d-457a-b2c0-b4137e60cace None admin] PATH_INFO: `/v3/users/2e114e59063a4d1da51f41cabd33c2ae` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:07.725936 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5421b-909d-457a-b2c0-b4137e60cace None admin] RBAC: Authorizing `identity:get_user(user_id=2e114e59063a4d1da51f41cabd33c2ae)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:07.727426 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5421b-909d-457a-b2c0-b4137e60cace None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:07.729219 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 181/359] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Sep 13 12:04:07 2022] GET /identity/v3/users/2e114e59063a4d1da51f41cabd33c2ae => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:07.729829 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5421b-909d-457a-b2c0-b4137e60cace None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:07.789484 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef317dee-65bf-4e67-adf0-dd64f10a119f None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:07.825379 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:07.833934 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f87b9-56c8-4c6b-b6c9-23e56d35a6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:07.834911 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f87b9-56c8-4c6b-b6c9-23e56d35a6da None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:07.835188 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f87b9-56c8-4c6b-b6c9-23e56d35a6da None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:07.835457 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f87b9-56c8-4c6b-b6c9-23e56d35a6da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:07.868448 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5421b-909d-457a-b2c0-b4137e60cace None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:07.905630 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454da38-b423-4b6a-9841-5f5fcc2ea9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:07.906336 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454da38-b423-4b6a-9841-5f5fcc2ea9d6 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:07.906541 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454da38-b423-4b6a-9841-5f5fcc2ea9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:07.906869 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454da38-b423-4b6a-9841-5f5fcc2ea9d6 None admin] PATH_INFO: `/v3/groups/c835dd1157c847beba445175d736aeec` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:07.909601 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0454da38-b423-4b6a-9841-5f5fcc2ea9d6 None admin] RBAC: Authorizing `identity:get_group(group_id=c835dd1157c847beba445175d736aeec)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:07.911100 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0454da38-b423-4b6a-9841-5f5fcc2ea9d6 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:07.912754 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 182/360] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Sep 13 12:04:07 2022] GET /identity/v3/groups/c835dd1157c847beba445175d736aeec => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:07.913475 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454da38-b423-4b6a-9841-5f5fcc2ea9d6 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:07.921632 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f87b9-56c8-4c6b-b6c9-23e56d35a6da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:07.923457 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f87b9-56c8-4c6b-b6c9-23e56d35a6da None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:07.943098 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:08.036207 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454da38-b423-4b6a-9841-5f5fcc2ea9d6 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:08.045924 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 179/361] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:04:08.047574 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eea50-19d0-44d4-a278-fd9445b38f3a None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:08.047866 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eea50-19d0-44d4-a278-fd9445b38f3a None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:08.048154 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461eea50-19d0-44d4-a278-fd9445b38f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:08.073852 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-461eea50-19d0-44d4-a278-fd9445b38f3a None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:08.075098 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-461eea50-19d0-44d4-a278-fd9445b38f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:08.080767 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c09a1-8b21-4bfa-abfa-97bc730be89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:08.081624 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c09a1-8b21-4bfa-abfa-97bc730be89c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:08.081958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c09a1-8b21-4bfa-abfa-97bc730be89c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:08.082154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c09a1-8b21-4bfa-abfa-97bc730be89c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:08.082962 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c09a1-8b21-4bfa-abfa-97bc730be89c None admin] RBAC: Adding query filter params (group.id=c835dd1157c847beba445175d736aeec, role.id=f396be01985a422c96d757a4c77a1fb1, scope.project.id=b8c35869b0184f978d0e9bb42b22ad27) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:08.083267 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c09a1-8b21-4bfa-abfa-97bc730be89c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:08.084739 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c09a1-8b21-4bfa-abfa-97bc730be89c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:08.087771 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:08.098645 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 183/362] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Sep 13 12:04:07 2022] GET /identity/v3/role_assignments?group.id=c835dd1157c847beba445175d736aeec&scope.project.id=b8c35869b0184f978d0e9bb42b22ad27&role.id=f396be01985a422c96d757a4c77a1fb1 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:08.098645 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c09a1-8b21-4bfa-abfa-97bc730be89c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:08.181489 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 180/363] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:08.182475 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461eea50-19d0-44d4-a278-fd9445b38f3a None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:08.251466 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c09a1-8b21-4bfa-abfa-97bc730be89c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:08.306373 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511d74a-2f06-4307-825d-8b4a7e5105c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:08.307548 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511d74a-2f06-4307-825d-8b4a7e5105c1 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:08.307840 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511d74a-2f06-4307-825d-8b4a7e5105c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:08.308452 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511d74a-2f06-4307-825d-8b4a7e5105c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:08.311033 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:08.327364 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511d74a-2f06-4307-825d-8b4a7e5105c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:08.335276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-1511d74a-2f06-4307-825d-8b4a7e5105c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:04:08.335276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:08.335276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:08.335276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:08.335276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:08.335276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:08.335276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:08.335276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:08.335276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:08.335276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:08.335276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:08.335276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:08.335276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:08.335276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:08.335276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:08.335276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:08.336181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:08.336181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:08.336181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:08.336181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:08.336181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:08.336181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:08.336181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:08.336181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:08.336181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:08.336181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:08.336181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:08.336181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:08.336181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:08.336181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:08.336181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:08.336181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:08.337774 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:08.337774 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:08.337774 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:08.337774 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:08.337774 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:08.337774 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:08.337774 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:08.337774 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:08.337774 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:08.337774 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:08.337774 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:04:08.337774 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:08.338377 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461eea50-19d0-44d4-a278-fd9445b38f3a None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:08.338447 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 184/364] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Sep 13 12:04:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:08.338447 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511d74a-2f06-4307-825d-8b4a7e5105c1 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:08.381640 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b828ac-32f4-43fd-88b4-3f98509185f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:08.382500 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b828ac-32f4-43fd-88b4-3f98509185f9 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:08.382830 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b828ac-32f4-43fd-88b4-3f98509185f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:08.383109 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b828ac-32f4-43fd-88b4-3f98509185f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:08.383849 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b828ac-32f4-43fd-88b4-3f98509185f9 None admin] RBAC: Adding query filter params (role.id=5e1d0d5215694636b5147ed0d216c047, user.id=2e114e59063a4d1da51f41cabd33c2ae, scope.system=all) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:08.384159 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b828ac-32f4-43fd-88b4-3f98509185f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:08.385823 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b828ac-32f4-43fd-88b4-3f98509185f9 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:08.406654 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 181/365] 10.222.0.15 () {56 vars in 1308 bytes} [Tue Sep 13 12:04:08 2022] GET /identity/v3/role_assignments?user.id=2e114e59063a4d1da51f41cabd33c2ae&scope.system=all&role.id=5e1d0d5215694636b5147ed0d216c047 => generated 510 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:08.406654 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b828ac-32f4-43fd-88b4-3f98509185f9 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:08.429619 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:08.509663 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511d74a-2f06-4307-825d-8b4a7e5105c1 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:08.575979 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b828ac-32f4-43fd-88b4-3f98509185f9 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:08.578894 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59e89c-b7a0-4e32-a9b1-2abe2ebbce33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:08.579515 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59e89c-b7a0-4e32-a9b1-2abe2ebbce33 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:08.579796 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59e89c-b7a0-4e32-a9b1-2abe2ebbce33 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:08.580748 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59e89c-b7a0-4e32-a9b1-2abe2ebbce33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:08.581578 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59e89c-b7a0-4e32-a9b1-2abe2ebbce33 None admin] RBAC: Adding query filter params (group.id=c835dd1157c847beba445175d736aeec, role.id=ab14a68bf5b54561badd35b83e6acaf5, scope.project.id=b8c35869b0184f978d0e9bb42b22ad27) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:08.581897 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59e89c-b7a0-4e32-a9b1-2abe2ebbce33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:08.583518 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59e89c-b7a0-4e32-a9b1-2abe2ebbce33 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:08.586130 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:08.590472 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 185/366] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Sep 13 12:04:08 2022] GET /identity/v3/role_assignments?group.id=c835dd1157c847beba445175d736aeec&scope.project.id=b8c35869b0184f978d0e9bb42b22ad27&role.id=ab14a68bf5b54561badd35b83e6acaf5 => generated 260 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:08.591453 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59e89c-b7a0-4e32-a9b1-2abe2ebbce33 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:08.647222 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd3d50-52bc-4b73-853b-495402da286c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:08.647875 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd3d50-52bc-4b73-853b-495402da286c None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:08.648155 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd3d50-52bc-4b73-853b-495402da286c None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:08.648432 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd3d50-52bc-4b73-853b-495402da286c None admin] PATH_INFO: `/v3/projects/85323b48b377409bb1a44ca2c635e0c4` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:08.653053 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd3d50-52bc-4b73-853b-495402da286c None admin] RBAC: Authorizing `identity:get_project(project_id=85323b48b377409bb1a44ca2c635e0c4)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:08.654876 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd3d50-52bc-4b73-853b-495402da286c None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:08.664451 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 182/367] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:08 2022] GET /identity/v3/projects/85323b48b377409bb1a44ca2c635e0c4 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:08.667010 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd3d50-52bc-4b73-853b-495402da286c None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:08.786904 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59e89c-b7a0-4e32-a9b1-2abe2ebbce33 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:08.819753 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:08.838493 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd3d50-52bc-4b73-853b-495402da286c None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:08.848129 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127cc40-a2c3-49a7-a6ee-b90a640a4e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:08.848879 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127cc40-a2c3-49a7-a6ee-b90a640a4e9c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:08.849158 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127cc40-a2c3-49a7-a6ee-b90a640a4e9c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:08.849432 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127cc40-a2c3-49a7-a6ee-b90a640a4e9c None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:08.850100 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127cc40-a2c3-49a7-a6ee-b90a640a4e9c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:08.850488 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127cc40-a2c3-49a7-a6ee-b90a640a4e9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:08.851983 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127cc40-a2c3-49a7-a6ee-b90a640a4e9c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:08.862745 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 186/368] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:08.863602 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127cc40-a2c3-49a7-a6ee-b90a640a4e9c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:08.884934 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ec623-25d3-4e69-8ff9-1c146608ecb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:08.885686 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ec623-25d3-4e69-8ff9-1c146608ecb4 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:08.886263 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ec623-25d3-4e69-8ff9-1c146608ecb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:08.886550 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ec623-25d3-4e69-8ff9-1c146608ecb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:08.899880 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ec623-25d3-4e69-8ff9-1c146608ecb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:08.904806 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-f49ec623-25d3-4e69-8ff9-1c146608ecb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:08.904806 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:08.904806 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:08.904806 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:08.904806 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:08.904806 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:08.904806 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:08.904806 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:08.904806 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:08.904806 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:08.904806 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:08.904806 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:08.904806 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:08.904806 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:08.904806 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:08.904806 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:08.905769 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:08.905769 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:08.905769 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:08.905769 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:08.905769 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:08.905769 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:08.905769 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:08.905769 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:08.905769 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:08.905769 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:08.905769 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:08.905769 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:08.905769 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:08.905769 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:08.905769 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:08.905769 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:08.907049 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:08.907049 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:08.907049 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:08.907049 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:08.907049 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:08.907049 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:08.907049 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:08.907049 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:08.907049 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:08.907049 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:08.907049 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:08.907049 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:08.911021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 183/369] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Sep 13 12:04:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:08.911909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ec623-25d3-4e69-8ff9-1c146608ecb4 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:08.958531 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:09.007344 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127cc40-a2c3-49a7-a6ee-b90a640a4e9c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:09.052255 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd81ac-1f2f-4313-9c05-2ca9c01c401a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:09.052896 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd81ac-1f2f-4313-9c05-2ca9c01c401a None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:09.053179 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd81ac-1f2f-4313-9c05-2ca9c01c401a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:09.053456 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd81ac-1f2f-4313-9c05-2ca9c01c401a None admin] PATH_INFO: `/v3/groups/c835dd1157c847beba445175d736aeec` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:09.054585 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd81ac-1f2f-4313-9c05-2ca9c01c401a None admin] RBAC: Authorizing `identity:get_group(group_id=c835dd1157c847beba445175d736aeec)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:09.056318 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd81ac-1f2f-4313-9c05-2ca9c01c401a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:09.059431 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ec623-25d3-4e69-8ff9-1c146608ecb4 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:09.061116 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 187/370] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Sep 13 12:04:08 2022] GET /identity/v3/groups/c835dd1157c847beba445175d736aeec => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:09.061955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd81ac-1f2f-4313-9c05-2ca9c01c401a None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:09.104474 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9c498-a410-421f-9238-c4d7d323e7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:09.105284 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9c498-a410-421f-9238-c4d7d323e7ed None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:09.105567 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9c498-a410-421f-9238-c4d7d323e7ed None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:09.106100 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9c498-a410-421f-9238-c4d7d323e7ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:09.157535 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:09.202690 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9c498-a410-421f-9238-c4d7d323e7ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:09.204179 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9c498-a410-421f-9238-c4d7d323e7ed None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:09.217322 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd81ac-1f2f-4313-9c05-2ca9c01c401a None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:09.253186 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:09.269478 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3c86c-0b74-4bb4-b1b1-49d7f00040bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:09.270658 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3c86c-0b74-4bb4-b1b1-49d7f00040bf None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:09.271576 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3c86c-0b74-4bb4-b1b1-49d7f00040bf None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:09.272007 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3c86c-0b74-4bb4-b1b1-49d7f00040bf None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:09.273161 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3c86c-0b74-4bb4-b1b1-49d7f00040bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:09.273874 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3c86c-0b74-4bb4-b1b1-49d7f00040bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:09.275990 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3c86c-0b74-4bb4-b1b1-49d7f00040bf None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:09.287954 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 188/371] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:09.289467 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3c86c-0b74-4bb4-b1b1-49d7f00040bf None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:09.342373 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 184/372] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:04:09.347620 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9c498-a410-421f-9238-c4d7d323e7ed None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:09.438904 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3c86c-0b74-4bb4-b1b1-49d7f00040bf None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:09.464718 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:09.476556 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9c498-a410-421f-9238-c4d7d323e7ed None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:09.493056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09c122-f08b-467e-88be-ab6a69fc428f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:09.494505 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09c122-f08b-467e-88be-ab6a69fc428f None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:09.495111 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09c122-f08b-467e-88be-ab6a69fc428f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:09.495653 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09c122-f08b-467e-88be-ab6a69fc428f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:09.496629 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09c122-f08b-467e-88be-ab6a69fc428f None admin] RBAC: Adding query filter params (group.id=c835dd1157c847beba445175d736aeec, role.id=ab14a68bf5b54561badd35b83e6acaf5, scope.project.id=85323b48b377409bb1a44ca2c635e0c4) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:09.497086 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09c122-f08b-467e-88be-ab6a69fc428f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:09.498841 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09c122-f08b-467e-88be-ab6a69fc428f None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:09.506712 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 189/373] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Sep 13 12:04:09 2022] GET /identity/v3/role_assignments?group.id=c835dd1157c847beba445175d736aeec&scope.project.id=85323b48b377409bb1a44ca2c635e0c4&role.id=ab14a68bf5b54561badd35b83e6acaf5 => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:09.508215 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09c122-f08b-467e-88be-ab6a69fc428f None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:09.525020 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff954c6-f5a7-4b7c-a551-e5fcc2d04da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:09.526352 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff954c6-f5a7-4b7c-a551-e5fcc2d04da7 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:09.526821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff954c6-f5a7-4b7c-a551-e5fcc2d04da7 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:09.527272 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff954c6-f5a7-4b7c-a551-e5fcc2d04da7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:09.531155 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:09.701297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09c122-f08b-467e-88be-ab6a69fc428f None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:09.723702 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff954c6-f5a7-4b7c-a551-e5fcc2d04da7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:09.725183 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff954c6-f5a7-4b7c-a551-e5fcc2d04da7 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:09.743999 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c08c1-e8fd-4477-9c2d-b4123551f55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:09.744659 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c08c1-e8fd-4477-9c2d-b4123551f55d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:09.744939 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c08c1-e8fd-4477-9c2d-b4123551f55d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:09.745214 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c08c1-e8fd-4477-9c2d-b4123551f55d None admin] PATH_INFO: `/v3/projects/85323b48b377409bb1a44ca2c635e0c4` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:09.747081 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c08c1-e8fd-4477-9c2d-b4123551f55d None admin] RBAC: Authorizing `identity:get_project(project_id=85323b48b377409bb1a44ca2c635e0c4)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:09.755503 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c08c1-e8fd-4477-9c2d-b4123551f55d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:09.757309 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 190/374] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:09 2022] GET /identity/v3/projects/85323b48b377409bb1a44ca2c635e0c4 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:09.767328 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c08c1-e8fd-4477-9c2d-b4123551f55d None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:09.834929 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:09.895589 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c08c1-e8fd-4477-9c2d-b4123551f55d None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:09.930399 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 185/375] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:04:09.938971 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff954c6-f5a7-4b7c-a551-e5fcc2d04da7 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:09.939580 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc55f4-3069-43bc-988a-67545ae014ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:09.940245 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc55f4-3069-43bc-988a-67545ae014ca None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:09.940937 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc55f4-3069-43bc-988a-67545ae014ca None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:09.941225 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc55f4-3069-43bc-988a-67545ae014ca None admin] PATH_INFO: `/v3/groups/c835dd1157c847beba445175d736aeec` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:09.942984 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc55f4-3069-43bc-988a-67545ae014ca None admin] RBAC: Authorizing `identity:get_group(group_id=c835dd1157c847beba445175d736aeec)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:09.944437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc55f4-3069-43bc-988a-67545ae014ca None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:09.947164 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 191/376] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Sep 13 12:04:09 2022] GET /identity/v3/groups/c835dd1157c847beba445175d736aeec => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:09.953019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc55f4-3069-43bc-988a-67545ae014ca None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:10.030825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:10.063743 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc55f4-3069-43bc-988a-67545ae014ca None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:10.081874 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:10.100503 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcbccc-929d-41ec-9d9a-a47714fa4c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:10.101122 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcbccc-929d-41ec-9d9a-a47714fa4c1c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:10.101405 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcbccc-929d-41ec-9d9a-a47714fa4c1c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:10.101694 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcbccc-929d-41ec-9d9a-a47714fa4c1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:10.102526 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defcbccc-929d-41ec-9d9a-a47714fa4c1c None admin] RBAC: Adding query filter params (group.id=c835dd1157c847beba445175d736aeec, role.id=f396be01985a422c96d757a4c77a1fb1, scope.project.id=85323b48b377409bb1a44ca2c635e0c4) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:10.102890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defcbccc-929d-41ec-9d9a-a47714fa4c1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:10.104443 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defcbccc-929d-41ec-9d9a-a47714fa4c1c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:10.110432 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 192/377] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Sep 13 12:04:09 2022] GET /identity/v3/role_assignments?group.id=c835dd1157c847beba445175d736aeec&scope.project.id=85323b48b377409bb1a44ca2c635e0c4&role.id=f396be01985a422c96d757a4c77a1fb1 => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:10.171306 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff954c6-f5a7-4b7c-a551-e5fcc2d04da7 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:10.226897 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45772810-bcf2-495e-8e9c-19bd3f860f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:10.227450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45772810-bcf2-495e-8e9c-19bd3f860f0f None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:10.227730 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45772810-bcf2-495e-8e9c-19bd3f860f0f None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:10.228008 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45772810-bcf2-495e-8e9c-19bd3f860f0f None admin] PATH_INFO: `/v3/projects/99ef8d30db4a4918b2622d7bdad47c3e` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:10.235538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45772810-bcf2-495e-8e9c-19bd3f860f0f None admin] RBAC: Authorizing `identity:get_project(project_id=99ef8d30db4a4918b2622d7bdad47c3e)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:10.237113 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45772810-bcf2-495e-8e9c-19bd3f860f0f None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:10.239162 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 186/378] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:09 2022] GET /identity/v3/projects/99ef8d30db4a4918b2622d7bdad47c3e => generated 344 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:10.244726 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcbccc-929d-41ec-9d9a-a47714fa4c1c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:10.385967 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcbccc-929d-41ec-9d9a-a47714fa4c1c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:10.427338 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0224f-b0d8-49db-8756-b74072644a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:10.428234 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0224f-b0d8-49db-8756-b74072644a31 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:10.428655 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0224f-b0d8-49db-8756-b74072644a31 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:10.429140 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0224f-b0d8-49db-8756-b74072644a31 None admin] PATH_INFO: `/v3/groups/66d4d7c92045421ca5919ce38bf5562e` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:10.440697 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0224f-b0d8-49db-8756-b74072644a31 None admin] RBAC: Authorizing `identity:get_group(group_id=66d4d7c92045421ca5919ce38bf5562e)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:10.442454 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0224f-b0d8-49db-8756-b74072644a31 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:10.444661 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 193/379] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Sep 13 12:04:10 2022] GET /identity/v3/groups/66d4d7c92045421ca5919ce38bf5562e => generated 229 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:10.450233 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45772810-bcf2-495e-8e9c-19bd3f860f0f None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:10.593459 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45772810-bcf2-495e-8e9c-19bd3f860f0f None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:10.595018 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:10.648558 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e0402-5fe1-4d7a-b056-481428bd344e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:10.649504 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e0402-5fe1-4d7a-b056-481428bd344e None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:10.649966 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e0402-5fe1-4d7a-b056-481428bd344e None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:10.650389 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e0402-5fe1-4d7a-b056-481428bd344e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:10.651672 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e0402-5fe1-4d7a-b056-481428bd344e None admin] RBAC: Adding query filter params (group.id=66d4d7c92045421ca5919ce38bf5562e, role.id=5609ac7373ba400593bba6d811e3aa72, scope.project.id=99ef8d30db4a4918b2622d7bdad47c3e) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:10.652171 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e0402-5fe1-4d7a-b056-481428bd344e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:10.653954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e0402-5fe1-4d7a-b056-481428bd344e None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:10.663249 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 187/380] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Sep 13 12:04:10 2022] GET /identity/v3/role_assignments?group.id=66d4d7c92045421ca5919ce38bf5562e&scope.project.id=99ef8d30db4a4918b2622d7bdad47c3e&role.id=5609ac7373ba400593bba6d811e3aa72 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:10.996164 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318e909-a25c-45ef-b629-f2e8dc51950c None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:10.996164 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318e909-a25c-45ef-b629-f2e8dc51950c None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:10.996164 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318e909-a25c-45ef-b629-f2e8dc51950c None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:10.997217 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 194/381] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:11.003830 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba40c3-4647-4754-8bd1-a31de902f6fc None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:11.004728 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba40c3-4647-4754-8bd1-a31de902f6fc None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:11.005207 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba40c3-4647-4754-8bd1-a31de902f6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:11.034596 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-b0ba40c3-4647-4754-8bd1-a31de902f6fc None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:11.036165 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-b0ba40c3-4647-4754-8bd1-a31de902f6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:11.136857 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 188/382] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:11.494763 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318e909-a25c-45ef-b629-f2e8dc51950c None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:11.557389 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:11.628617 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318e909-a25c-45ef-b629-f2e8dc51950c None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:11.682183 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652120c-487c-4614-a034-48177b3209be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:11.682898 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652120c-487c-4614-a034-48177b3209be None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:11.683178 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652120c-487c-4614-a034-48177b3209be None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:11.683459 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652120c-487c-4614-a034-48177b3209be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:11.702517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652120c-487c-4614-a034-48177b3209be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:11.708019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-a652120c-487c-4614-a034-48177b3209be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:04:11.708019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:11.708019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:11.708019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:11.708019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:11.708019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:11.708019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:11.708019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:11.708019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:11.708019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:11.708019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:11.708019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:11.708019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:11.708019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:11.708019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:11.708019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:11.708934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:11.708934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:11.708934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:11.708934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:11.708934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:11.708934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:11.708934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:11.708934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:11.708934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:11.708934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:11.708934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:11.708934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:11.708934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:11.708934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:11.708934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:11.708934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:11.709754 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:11.709754 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:11.709754 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:11.709754 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:11.709754 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:11.709754 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:11.709754 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:11.709754 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:11.709754 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:11.709754 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:11.709754 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:04:11.709754 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:11.709754 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 195/383] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Sep 13 12:04:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:11.715068 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba40c3-4647-4754-8bd1-a31de902f6fc None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:11.753203 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b33e9-b9d1-4930-b8d2-72649380acff None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:11.753377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b33e9-b9d1-4930-b8d2-72649380acff None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:11.753660 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b33e9-b9d1-4930-b8d2-72649380acff None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:11.755195 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 196/384] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:11.764857 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc655e0-966c-4507-9b3e-2122d9f93f8b None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:11.765412 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc655e0-966c-4507-9b3e-2122d9f93f8b None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:11.765844 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc655e0-966c-4507-9b3e-2122d9f93f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:11.792073 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-8dc655e0-966c-4507-9b3e-2122d9f93f8b None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:11.793553 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-8dc655e0-966c-4507-9b3e-2122d9f93f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:11.864913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:11.880172 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba40c3-4647-4754-8bd1-a31de902f6fc None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:11.936568 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 197/385] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:11.960739 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08819ea2-a503-42ac-bd5a-85ae634c13df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:11.961364 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08819ea2-a503-42ac-bd5a-85ae634c13df None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:11.961647 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08819ea2-a503-42ac-bd5a-85ae634c13df None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:11.961924 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08819ea2-a503-42ac-bd5a-85ae634c13df None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:11.962606 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08819ea2-a503-42ac-bd5a-85ae634c13df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:11.962948 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08819ea2-a503-42ac-bd5a-85ae634c13df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:11.964333 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08819ea2-a503-42ac-bd5a-85ae634c13df None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:11.982216 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 189/386] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:11.988038 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc655e0-966c-4507-9b3e-2122d9f93f8b None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:12.029912 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:12.123296 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc655e0-966c-4507-9b3e-2122d9f93f8b None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:12.171594 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11abed-43a6-4d3f-9537-93884197f53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:12.172259 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11abed-43a6-4d3f-9537-93884197f53b None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:12.172545 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11abed-43a6-4d3f-9537-93884197f53b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:12.172824 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11abed-43a6-4d3f-9537-93884197f53b None admin] PATH_INFO: `/v3/groups/c835dd1157c847beba445175d736aeec` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:12.174558 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11abed-43a6-4d3f-9537-93884197f53b None admin] RBAC: Authorizing `identity:get_group(group_id=c835dd1157c847beba445175d736aeec)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:12.176022 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11abed-43a6-4d3f-9537-93884197f53b None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:12.178004 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 198/387] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Sep 13 12:04:11 2022] GET /identity/v3/groups/c835dd1157c847beba445175d736aeec => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:12.183108 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08819ea2-a503-42ac-bd5a-85ae634c13df None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:12.315540 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08819ea2-a503-42ac-bd5a-85ae634c13df None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:12.360280 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11abed-43a6-4d3f-9537-93884197f53b None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:12.364304 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1079f-62e7-42ed-94ae-5425e929e7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:12.364963 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1079f-62e7-42ed-94ae-5425e929e7cc None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:12.365242 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1079f-62e7-42ed-94ae-5425e929e7cc None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:12.365512 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1079f-62e7-42ed-94ae-5425e929e7cc None admin] PATH_INFO: `/v3/projects/b8c35869b0184f978d0e9bb42b22ad27` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:12.366694 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1079f-62e7-42ed-94ae-5425e929e7cc None admin] RBAC: Authorizing `identity:get_project(project_id=b8c35869b0184f978d0e9bb42b22ad27)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:12.368180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1079f-62e7-42ed-94ae-5425e929e7cc None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:12.370223 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 190/388] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:12 2022] GET /identity/v3/projects/b8c35869b0184f978d0e9bb42b22ad27 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:12.376072 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1079f-62e7-42ed-94ae-5425e929e7cc None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:12.432703 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:12.510543 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11abed-43a6-4d3f-9537-93884197f53b None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:12.512165 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:12.538121 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1079f-62e7-42ed-94ae-5425e929e7cc None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:12.550543 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7d9b3-eacd-4bb4-aa9b-868f3fa7a241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:12.551216 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7d9b3-eacd-4bb4-aa9b-868f3fa7a241 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:12.551500 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7d9b3-eacd-4bb4-aa9b-868f3fa7a241 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:12.551776 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7d9b3-eacd-4bb4-aa9b-868f3fa7a241 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:12.562359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7d9b3-eacd-4bb4-aa9b-868f3fa7a241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:12.567489 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-0be7d9b3-eacd-4bb4-aa9b-868f3fa7a241 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:04:12.567489 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:12.567489 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:12.567489 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:12.567489 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:12.567489 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:12.567489 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:12.567489 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:12.567489 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:12.567489 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:12.567489 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:12.567489 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:12.567489 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:12.567489 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:12.567489 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:12.567489 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:12.568395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:12.568395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:12.568395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:12.568395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:12.568395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:12.568395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:12.568395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:12.568395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:12.568395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:12.568395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:12.568395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:12.568395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:12.568395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:12.568395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:12.568395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:12.568395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:12.569596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:12.569596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:12.569596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:12.569596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:12.569596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:12.569596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:12.569596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:12.569596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:12.569596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:12.569596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:12.569596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:04:12.569596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:12.569596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 199/389] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:12.570280 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f0ade-aac6-4f36-b71f-6290a48b75db None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:12.570344 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f0ade-aac6-4f36-b71f-6290a48b75db None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:12.570704 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f0ade-aac6-4f36-b71f-6290a48b75db None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:12.572195 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 200/390] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:12.577273 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26b804-1b18-4d6d-a0d7-464b9447d0f8 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:12.577553 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26b804-1b18-4d6d-a0d7-464b9447d0f8 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:12.577825 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26b804-1b18-4d6d-a0d7-464b9447d0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:12.589272 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f072fe-5717-4631-8327-153bcb6630bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:12.590298 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f072fe-5717-4631-8327-153bcb6630bf None admin] REQUEST_METHOD: `PUT` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:12.590879 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f072fe-5717-4631-8327-153bcb6630bf None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:12.591356 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f072fe-5717-4631-8327-153bcb6630bf None admin] PATH_INFO: `/v3/projects/b8c35869b0184f978d0e9bb42b22ad27/groups/c835dd1157c847beba445175d736aeec/roles/f396be01985a422c96d757a4c77a1fb1` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:12.594021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f072fe-5717-4631-8327-153bcb6630bf None admin] RBAC: Authorizing `identity:create_grant(project_id=b8c35869b0184f978d0e9bb42b22ad27, group_id=c835dd1157c847beba445175d736aeec, role_id=f396be01985a422c96d757a4c77a1fb1)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:12.596613 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f072fe-5717-4631-8327-153bcb6630bf None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:12.598793 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-3b26b804-1b18-4d6d-a0d7-464b9447d0f8 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:12.600081 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-3b26b804-1b18-4d6d-a0d7-464b9447d0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:12.614405 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 191/391] 10.222.0.15 () {58 vars in 1442 bytes} [Tue Sep 13 12:04:12 2022] PUT /identity/v3/projects/b8c35869b0184f978d0e9bb42b22ad27/groups/c835dd1157c847beba445175d736aeec/roles/f396be01985a422c96d757a4c77a1fb1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:04:12.616343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f072fe-5717-4631-8327-153bcb6630bf None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:12.708004 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 201/392] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:04:12.729013 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:12.753466 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f072fe-5717-4631-8327-153bcb6630bf None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:12.793020 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d047c-1fe4-4c4c-9363-57c484a3e445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:12.793714 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d047c-1fe4-4c4c-9363-57c484a3e445 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:12.793996 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d047c-1fe4-4c4c-9363-57c484a3e445 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:12.794361 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d047c-1fe4-4c4c-9363-57c484a3e445 None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:12.795085 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d047c-1fe4-4c4c-9363-57c484a3e445 None admin] RBAC: Adding query filter params (name=member) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:12.795385 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d047c-1fe4-4c4c-9363-57c484a3e445 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:12.796745 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d047c-1fe4-4c4c-9363-57c484a3e445 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:12.806498 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 192/393] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:04:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:12.815763 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26b804-1b18-4d6d-a0d7-464b9447d0f8 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:12.934589 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:12.946274 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26b804-1b18-4d6d-a0d7-464b9447d0f8 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:12.994403 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6281b5-3344-47e1-b9fb-efe68436da93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:12.995104 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6281b5-3344-47e1-b9fb-efe68436da93 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:12.995379 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6281b5-3344-47e1-b9fb-efe68436da93 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:12.995693 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6281b5-3344-47e1-b9fb-efe68436da93 None admin] PATH_INFO: `/v3/groups/c835dd1157c847beba445175d736aeec` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:12.996884 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6281b5-3344-47e1-b9fb-efe68436da93 None admin] RBAC: Authorizing `identity:get_group(group_id=c835dd1157c847beba445175d736aeec)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:12.998398 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6281b5-3344-47e1-b9fb-efe68436da93 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:13.000515 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 202/394] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Sep 13 12:04:12 2022] GET /identity/v3/groups/c835dd1157c847beba445175d736aeec => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:13.006943 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d047c-1fe4-4c4c-9363-57c484a3e445 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:13.090996 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6281b5-3344-47e1-b9fb-efe68436da93 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:13.120684 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d047c-1fe4-4c4c-9363-57c484a3e445 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:13.165539 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc4df5-6a39-4b92-b9e3-6c65e41082a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:13.166171 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc4df5-6a39-4b92-b9e3-6c65e41082a1 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:13.166454 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc4df5-6a39-4b92-b9e3-6c65e41082a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:13.166794 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc4df5-6a39-4b92-b9e3-6c65e41082a1 None admin] PATH_INFO: `/v3/projects/b8c35869b0184f978d0e9bb42b22ad27` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:13.168618 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc4df5-6a39-4b92-b9e3-6c65e41082a1 None admin] RBAC: Authorizing `identity:get_project(project_id=b8c35869b0184f978d0e9bb42b22ad27)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:13.170060 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc4df5-6a39-4b92-b9e3-6c65e41082a1 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:13.172809 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 193/395] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:13 2022] GET /identity/v3/projects/b8c35869b0184f978d0e9bb42b22ad27 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:13.177733 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc4df5-6a39-4b92-b9e3-6c65e41082a1 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:13.212347 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:13.249654 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6281b5-3344-47e1-b9fb-efe68436da93 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:13.317128 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc4df5-6a39-4b92-b9e3-6c65e41082a1 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:13.353290 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8a887-faf5-4b37-b169-ff75e21d37d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:13.353951 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8a887-faf5-4b37-b169-ff75e21d37d9 None admin] REQUEST_METHOD: `PUT` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:13.354229 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8a887-faf5-4b37-b169-ff75e21d37d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:13.354502 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8a887-faf5-4b37-b169-ff75e21d37d9 None admin] PATH_INFO: `/v3/projects/b8c35869b0184f978d0e9bb42b22ad27/groups/c835dd1157c847beba445175d736aeec/roles/ab14a68bf5b54561badd35b83e6acaf5` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:13.356542 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8a887-faf5-4b37-b169-ff75e21d37d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8c35869b0184f978d0e9bb42b22ad27, group_id=c835dd1157c847beba445175d736aeec, role_id=ab14a68bf5b54561badd35b83e6acaf5)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:13.357980 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8a887-faf5-4b37-b169-ff75e21d37d9 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:13.371337 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991fa6f-1e68-4113-a658-239fd40eff4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:13.371994 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991fa6f-1e68-4113-a658-239fd40eff4b None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:13.372266 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991fa6f-1e68-4113-a658-239fd40eff4b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:13.372540 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991fa6f-1e68-4113-a658-239fd40eff4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:13.372637 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 194/396] 10.222.0.15 () {58 vars in 1442 bytes} [Tue Sep 13 12:04:13 2022] PUT /identity/v3/projects/b8c35869b0184f978d0e9bb42b22ad27/groups/c835dd1157c847beba445175d736aeec/roles/ab14a68bf5b54561badd35b83e6acaf5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:04:13.406324 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991fa6f-1e68-4113-a658-239fd40eff4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:13.413076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-3991fa6f-1e68-4113-a658-239fd40eff4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:04:13.413076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:13.413076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:13.413076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:13.413076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:13.413076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:13.413076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:13.413076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:13.413076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:13.413076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:13.413076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:13.413076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:13.413076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:13.413076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:13.413076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:13.413076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:13.414237 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:13.414237 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:13.414237 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:13.414237 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:13.414237 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:13.414237 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:13.414237 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:13.414237 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:13.414237 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:13.414237 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:13.414237 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:13.414237 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:13.414237 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:13.414237 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:13.414237 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:13.414237 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:13.415471 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:13.415471 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:13.415471 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:13.415471 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:13.415471 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:13.415471 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:13.415471 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:13.415471 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:13.415471 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:13.415471 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:13.415471 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:04:13.415471 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:13.415471 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 203/397] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:04:13.422344 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8a887-faf5-4b37-b169-ff75e21d37d9 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:13.508084 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f923a-aa56-4e90-956c-ca24d3d8d4cd None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:13.508395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f923a-aa56-4e90-956c-ca24d3d8d4cd None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:13.508585 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f923a-aa56-4e90-956c-ca24d3d8d4cd None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:13.510176 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 204/398] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:04:13.518676 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e8cb4-de13-4042-a0ef-8863b5fbf5f2 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:13.518982 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e8cb4-de13-4042-a0ef-8863b5fbf5f2 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:13.519268 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e8cb4-de13-4042-a0ef-8863b5fbf5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:13.538999 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:13.556789 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-de8e8cb4-de13-4042-a0ef-8863b5fbf5f2 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:13.558378 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-de8e8cb4-de13-4042-a0ef-8863b5fbf5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:13.576729 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:13.608155 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8a887-faf5-4b37-b169-ff75e21d37d9 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:13.648508 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 205/399] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:04:13.685682 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f52b50-6fed-4b20-b450-1f0f807f0ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:13.686302 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f52b50-6fed-4b20-b450-1f0f807f0ded None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:13.686582 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f52b50-6fed-4b20-b450-1f0f807f0ded None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:13.686888 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f52b50-6fed-4b20-b450-1f0f807f0ded None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:13.687560 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f52b50-6fed-4b20-b450-1f0f807f0ded None admin] RBAC: Adding query filter params (name=member) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:13.687867 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f52b50-6fed-4b20-b450-1f0f807f0ded None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:13.689816 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f52b50-6fed-4b20-b450-1f0f807f0ded None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:13.700904 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 195/400] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:04:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:13.706649 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e8cb4-de13-4042-a0ef-8863b5fbf5f2 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:13.834385 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e8cb4-de13-4042-a0ef-8863b5fbf5f2 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:13.896924 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c23ce-27aa-4d1a-a3e2-047fbf857ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:13.897941 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c23ce-27aa-4d1a-a3e2-047fbf857ec5 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:13.898437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c23ce-27aa-4d1a-a3e2-047fbf857ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:13.898929 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c23ce-27aa-4d1a-a3e2-047fbf857ec5 None admin] PATH_INFO: `/v3/groups/c835dd1157c847beba445175d736aeec` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:13.900250 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c23ce-27aa-4d1a-a3e2-047fbf857ec5 None admin] RBAC: Authorizing `identity:get_group(group_id=c835dd1157c847beba445175d736aeec)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:13.901867 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c23ce-27aa-4d1a-a3e2-047fbf857ec5 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:13.903662 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 206/401] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Sep 13 12:04:13 2022] GET /identity/v3/groups/c835dd1157c847beba445175d736aeec => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:13.909272 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f52b50-6fed-4b20-b450-1f0f807f0ded None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:13.930110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16add9b9-4a72-41a3-bfd0-aef71cd752aa None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:13.930409 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16add9b9-4a72-41a3-bfd0-aef71cd752aa None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:13.930706 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16add9b9-4a72-41a3-bfd0-aef71cd752aa None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:13.932275 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 207/402] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:04:13.937568 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219aa92-332c-41fb-87d1-b79a858d7f92 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:13.937854 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219aa92-332c-41fb-87d1-b79a858d7f92 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:13.938131 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219aa92-332c-41fb-87d1-b79a858d7f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:13.959639 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-1219aa92-332c-41fb-87d1-b79a858d7f92 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:13.960836 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-1219aa92-332c-41fb-87d1-b79a858d7f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:13.978988 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:14.087408 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 208/403] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:14.093168 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219aa92-332c-41fb-87d1-b79a858d7f92 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:14.122867 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f52b50-6fed-4b20-b450-1f0f807f0ded None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:14.198304 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ae0a3-8eee-4f2e-bbcd-32c047a691ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:14.199069 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ae0a3-8eee-4f2e-bbcd-32c047a691ea None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:14.199352 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ae0a3-8eee-4f2e-bbcd-32c047a691ea None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:14.199631 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ae0a3-8eee-4f2e-bbcd-32c047a691ea None admin] PATH_INFO: `/v3/projects/85323b48b377409bb1a44ca2c635e0c4` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:14.201843 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ae0a3-8eee-4f2e-bbcd-32c047a691ea None admin] RBAC: Authorizing `identity:get_project(project_id=85323b48b377409bb1a44ca2c635e0c4)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:14.203335 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ae0a3-8eee-4f2e-bbcd-32c047a691ea None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:14.206854 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 196/404] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:13 2022] GET /identity/v3/projects/85323b48b377409bb1a44ca2c635e0c4 => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:14.213064 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ae0a3-8eee-4f2e-bbcd-32c047a691ea None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:14.229104 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:14.275951 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219aa92-332c-41fb-87d1-b79a858d7f92 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:14.348623 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcf48b-ccd2-4f8d-9c09-5c9f8a3cc87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:14.349179 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcf48b-ccd2-4f8d-9c09-5c9f8a3cc87b None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:14.349461 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcf48b-ccd2-4f8d-9c09-5c9f8a3cc87b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:14.349851 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbcf48b-ccd2-4f8d-9c09-5c9f8a3cc87b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:14.380587 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbcf48b-ccd2-4f8d-9c09-5c9f8a3cc87b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:14.385502 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-7bbcf48b-ccd2-4f8d-9c09-5c9f8a3cc87b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:04:14.385502 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:14.385502 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:14.385502 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:14.385502 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:14.385502 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:14.385502 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:14.385502 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:14.385502 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:14.385502 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:14.385502 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:14.385502 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:14.385502 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:14.385502 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:14.385502 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:14.385502 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:14.386369 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:14.386369 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:14.386369 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:14.386369 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:14.386369 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:14.386369 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:14.386369 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:14.386369 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:14.386369 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:14.386369 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:14.386369 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:14.386369 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:14.386369 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:14.386369 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:14.386369 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:14.386369 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:14.387193 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:14.387193 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:14.387193 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:14.387193 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:14.387193 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:14.387193 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:14.387193 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:14.387193 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:14.387193 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:14.387193 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:14.387193 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:04:14.387193 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:14.390329 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 209/405] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Sep 13 12:04:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:04:14.397220 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcf48b-ccd2-4f8d-9c09-5c9f8a3cc87b None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:14.400942 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ae0a3-8eee-4f2e-bbcd-32c047a691ea None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:14.422945 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:14.463689 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378b46f-09d2-4b0d-ac87-43bde92b23ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:14.464633 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378b46f-09d2-4b0d-ac87-43bde92b23ad None admin] REQUEST_METHOD: `PUT` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:14.464961 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378b46f-09d2-4b0d-ac87-43bde92b23ad None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:14.465279 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378b46f-09d2-4b0d-ac87-43bde92b23ad None admin] PATH_INFO: `/v3/projects/85323b48b377409bb1a44ca2c635e0c4/groups/c835dd1157c847beba445175d736aeec/roles/ab14a68bf5b54561badd35b83e6acaf5` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:14.472269 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378b46f-09d2-4b0d-ac87-43bde92b23ad None admin] RBAC: Authorizing `identity:create_grant(project_id=85323b48b377409bb1a44ca2c635e0c4, group_id=c835dd1157c847beba445175d736aeec, role_id=ab14a68bf5b54561badd35b83e6acaf5)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:14.474067 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378b46f-09d2-4b0d-ac87-43bde92b23ad None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:14.491085 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 197/406] 10.222.0.15 () {58 vars in 1442 bytes} [Tue Sep 13 12:04:14 2022] PUT /identity/v3/projects/85323b48b377409bb1a44ca2c635e0c4/groups/c835dd1157c847beba445175d736aeec/roles/ab14a68bf5b54561badd35b83e6acaf5 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:04:14.498643 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378b46f-09d2-4b0d-ac87-43bde92b23ad None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:14.546516 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbcf48b-ccd2-4f8d-9c09-5c9f8a3cc87b None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:14.590104 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc132447-6b08-44ac-af94-47586a301306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:14.590769 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc132447-6b08-44ac-af94-47586a301306 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:14.591053 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc132447-6b08-44ac-af94-47586a301306 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:14.591387 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc132447-6b08-44ac-af94-47586a301306 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:14.592271 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc132447-6b08-44ac-af94-47586a301306 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:14.592591 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc132447-6b08-44ac-af94-47586a301306 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:14.594099 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc132447-6b08-44ac-af94-47586a301306 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:14.604416 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 210/407] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:14.613294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc132447-6b08-44ac-af94-47586a301306 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:14.646405 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:14.719828 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378b46f-09d2-4b0d-ac87-43bde92b23ad None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:14.780378 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:14.788238 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f62bd5-3053-403d-bd7a-6a095c90632b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:14.789105 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f62bd5-3053-403d-bd7a-6a095c90632b None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:14.789538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f62bd5-3053-403d-bd7a-6a095c90632b None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:14.790753 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f62bd5-3053-403d-bd7a-6a095c90632b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:14.806969 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f62bd5-3053-403d-bd7a-6a095c90632b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:14.815083 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-31f62bd5-3053-403d-bd7a-6a095c90632b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:14.815083 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:14.815083 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:14.815083 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:14.815083 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:14.815083 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:14.815083 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:14.815083 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:14.815083 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:14.815083 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:14.815083 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:14.815083 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:14.815083 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:14.815083 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:14.815083 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:14.815083 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:14.815968 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:14.815968 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:14.815968 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:14.815968 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:14.815968 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:14.815968 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:14.815968 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:14.815968 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:14.815968 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:14.815968 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:14.815968 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:14.815968 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:14.815968 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:14.815968 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:14.815968 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:14.815968 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:14.816750 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:14.816750 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:14.816750 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:14.816750 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:14.816750 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:14.816750 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:14.816750 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:14.816750 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:14.816750 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:14.816750 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:14.816750 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:14.816750 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:14.819229 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 198/408] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Sep 13 12:04:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:14.821921 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc132447-6b08-44ac-af94-47586a301306 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:14.826848 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f62bd5-3053-403d-bd7a-6a095c90632b None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:14.869404 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee47daf-a097-42fd-aa2d-4091592b41e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:14.870055 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee47daf-a097-42fd-aa2d-4091592b41e2 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:14.870334 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee47daf-a097-42fd-aa2d-4091592b41e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:14.870623 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee47daf-a097-42fd-aa2d-4091592b41e2 None admin] PATH_INFO: `/v3/groups/c835dd1157c847beba445175d736aeec` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:14.871780 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee47daf-a097-42fd-aa2d-4091592b41e2 None admin] RBAC: Authorizing `identity:get_group(group_id=c835dd1157c847beba445175d736aeec)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:14.873221 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee47daf-a097-42fd-aa2d-4091592b41e2 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:14.875196 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 211/409] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Sep 13 12:04:14 2022] GET /identity/v3/groups/c835dd1157c847beba445175d736aeec => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:14.884047 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee47daf-a097-42fd-aa2d-4091592b41e2 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:14.954158 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f62bd5-3053-403d-bd7a-6a095c90632b None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:14.981764 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:14.992421 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a03c13-0ba9-460c-b605-1c8a86aa62af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:14.993127 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a03c13-0ba9-460c-b605-1c8a86aa62af None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:14.993408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a03c13-0ba9-460c-b605-1c8a86aa62af None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:14.993779 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a03c13-0ba9-460c-b605-1c8a86aa62af None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:14.994447 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a03c13-0ba9-460c-b605-1c8a86aa62af None admin] RBAC: Adding query filter params (name=admin) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:14.994782 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a03c13-0ba9-460c-b605-1c8a86aa62af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:14.996150 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a03c13-0ba9-460c-b605-1c8a86aa62af None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:15.006292 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 199/410] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:15.015620 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a03c13-0ba9-460c-b605-1c8a86aa62af None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:15.123415 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee47daf-a097-42fd-aa2d-4091592b41e2 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:15.193866 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a03c13-0ba9-460c-b605-1c8a86aa62af None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:15.198250 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e299e4-7b1b-471a-9f2c-6b95791bc857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:15.199203 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e299e4-7b1b-471a-9f2c-6b95791bc857 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:15.200376 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e299e4-7b1b-471a-9f2c-6b95791bc857 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:15.201065 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e299e4-7b1b-471a-9f2c-6b95791bc857 None admin] PATH_INFO: `/v3/projects/85323b48b377409bb1a44ca2c635e0c4` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:15.207047 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e299e4-7b1b-471a-9f2c-6b95791bc857 None admin] RBAC: Authorizing `identity:get_project(project_id=85323b48b377409bb1a44ca2c635e0c4)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:15.208778 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e299e4-7b1b-471a-9f2c-6b95791bc857 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:15.210737 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 212/411] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:14 2022] GET /identity/v3/projects/85323b48b377409bb1a44ca2c635e0c4 => generated 302 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:15.220937 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e299e4-7b1b-471a-9f2c-6b95791bc857 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:15.234336 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:15.284351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b32f33-4b33-4f6c-84a1-d5284be271dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:15.285025 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b32f33-4b33-4f6c-84a1-d5284be271dd None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:15.285264 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b32f33-4b33-4f6c-84a1-d5284be271dd None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:15.285536 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b32f33-4b33-4f6c-84a1-d5284be271dd None admin] PATH_INFO: `/v3/groups/66d4d7c92045421ca5919ce38bf5562e` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:15.286672 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b32f33-4b33-4f6c-84a1-d5284be271dd None admin] RBAC: Authorizing `identity:get_group(group_id=66d4d7c92045421ca5919ce38bf5562e)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:15.288218 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b32f33-4b33-4f6c-84a1-d5284be271dd None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:15.290968 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 200/412] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Sep 13 12:04:15 2022] GET /identity/v3/groups/66d4d7c92045421ca5919ce38bf5562e => generated 229 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:15.296641 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b32f33-4b33-4f6c-84a1-d5284be271dd None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:15.353260 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e299e4-7b1b-471a-9f2c-6b95791bc857 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:15.395138 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9b737-94b7-4e23-8abc-3f66752707c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:15.396235 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9b737-94b7-4e23-8abc-3f66752707c5 None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:15.396753 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9b737-94b7-4e23-8abc-3f66752707c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:15.397242 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9b737-94b7-4e23-8abc-3f66752707c5 None admin] PATH_INFO: `/v3/projects/85323b48b377409bb1a44ca2c635e0c4/groups/c835dd1157c847beba445175d736aeec/roles/f396be01985a422c96d757a4c77a1fb1` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:15.399889 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9b737-94b7-4e23-8abc-3f66752707c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=85323b48b377409bb1a44ca2c635e0c4, group_id=c835dd1157c847beba445175d736aeec, role_id=f396be01985a422c96d757a4c77a1fb1)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:15.401533 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9b737-94b7-4e23-8abc-3f66752707c5 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:15.415566 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:15.433312 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 213/413] 10.222.0.15 () {58 vars in 1442 bytes} [Tue Sep 13 12:04:15 2022] PUT /identity/v3/projects/85323b48b377409bb1a44ca2c635e0c4/groups/c835dd1157c847beba445175d736aeec/roles/f396be01985a422c96d757a4c77a1fb1 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:04:15.475661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b32f33-4b33-4f6c-84a1-d5284be271dd None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:15.518101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bff9c-4ce6-48e7-b21e-10087e01eb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:15.519180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bff9c-4ce6-48e7-b21e-10087e01eb1b None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:15.519587 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bff9c-4ce6-48e7-b21e-10087e01eb1b None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:15.519869 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bff9c-4ce6-48e7-b21e-10087e01eb1b None admin] PATH_INFO: `/v3/projects/99ef8d30db4a4918b2622d7bdad47c3e` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:15.521114 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bff9c-4ce6-48e7-b21e-10087e01eb1b None admin] RBAC: Authorizing `identity:get_project(project_id=99ef8d30db4a4918b2622d7bdad47c3e)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:15.523132 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bff9c-4ce6-48e7-b21e-10087e01eb1b None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:15.526282 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 201/414] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:15 2022] GET /identity/v3/projects/99ef8d30db4a4918b2622d7bdad47c3e => generated 344 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:15.533890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9b737-94b7-4e23-8abc-3f66752707c5 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:15.621440 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:15.672161 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9b737-94b7-4e23-8abc-3f66752707c5 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:15.725496 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab554c1a-2c0d-4709-9f6d-020d45dccdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:15.726212 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab554c1a-2c0d-4709-9f6d-020d45dccdc8 None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:15.726490 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab554c1a-2c0d-4709-9f6d-020d45dccdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:15.726783 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab554c1a-2c0d-4709-9f6d-020d45dccdc8 None admin] PATH_INFO: `/v3/projects/99ef8d30db4a4918b2622d7bdad47c3e/groups/66d4d7c92045421ca5919ce38bf5562e/roles/5609ac7373ba400593bba6d811e3aa72` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:15.731932 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab554c1a-2c0d-4709-9f6d-020d45dccdc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=99ef8d30db4a4918b2622d7bdad47c3e, group_id=66d4d7c92045421ca5919ce38bf5562e, role_id=5609ac7373ba400593bba6d811e3aa72)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:15.733370 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab554c1a-2c0d-4709-9f6d-020d45dccdc8 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:15.750338 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 214/415] 10.222.0.15 () {58 vars in 1442 bytes} [Tue Sep 13 12:04:15 2022] PUT /identity/v3/projects/99ef8d30db4a4918b2622d7bdad47c3e/groups/66d4d7c92045421ca5919ce38bf5562e/roles/5609ac7373ba400593bba6d811e3aa72 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:04:15.852504 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867288a4-c018-4a39-a158-96c07c70c673 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:15.852954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867288a4-c018-4a39-a158-96c07c70c673 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:15.853314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867288a4-c018-4a39-a158-96c07c70c673 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:15.854706 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 202/416] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:15.860410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ba110-6c98-4f82-8bab-5e6d35e9b8e9 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:15.860696 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ba110-6c98-4f82-8bab-5e6d35e9b8e9 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:15.861495 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ba110-6c98-4f82-8bab-5e6d35e9b8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:15.883651 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-b41ba110-6c98-4f82-8bab-5e6d35e9b8e9 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:15.884885 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-b41ba110-6c98-4f82-8bab-5e6d35e9b8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:15.963998 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 215/417] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:16.255651 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce42141-a4f1-4a92-a5c6-2ba8d7958ff6 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:16.255835 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce42141-a4f1-4a92-a5c6-2ba8d7958ff6 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:16.256194 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce42141-a4f1-4a92-a5c6-2ba8d7958ff6 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:16.257675 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 203/418] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:16.263293 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd693c46-feaf-4773-8e17-c718187c7517 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:16.263734 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd693c46-feaf-4773-8e17-c718187c7517 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:16.263826 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd693c46-feaf-4773-8e17-c718187c7517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:16.291622 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-dd693c46-feaf-4773-8e17-c718187c7517 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:16.292821 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-dd693c46-feaf-4773-8e17-c718187c7517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:16.359773 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:16.382430 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 216/419] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:16.401622 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce42141-a4f1-4a92-a5c6-2ba8d7958ff6 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:16.529947 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce42141-a4f1-4a92-a5c6-2ba8d7958ff6 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:16.554711 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:16.566395 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ae56c-ed83-4996-848b-25ea05ebd02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:16.567088 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ae56c-ed83-4996-848b-25ea05ebd02b None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:16.567377 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ae56c-ed83-4996-848b-25ea05ebd02b None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:16.567654 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ae56c-ed83-4996-848b-25ea05ebd02b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:16.585184 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ae56c-ed83-4996-848b-25ea05ebd02b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:16.590005 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-e15ae56c-ed83-4996-848b-25ea05ebd02b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:04:16.590005 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:16.590005 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:16.590005 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:16.590005 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:16.590005 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:16.590005 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:16.590005 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:16.590005 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:16.590005 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:16.590005 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:16.590005 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:16.590005 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:16.590005 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:16.590005 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:16.590005 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:16.590913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:16.590913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:16.590913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:16.590913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:16.590913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:16.590913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:16.590913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:16.590913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:16.590913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:16.590913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:16.590913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:16.590913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:16.590913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:16.590913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:16.590913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:16.590913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:16.591688 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:16.591688 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:16.591688 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:16.591688 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:16.591688 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:16.591688 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:16.591688 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:16.591688 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:16.591688 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:16.591688 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:16.591688 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:04:16.591688 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:16.591688 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 204/420] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Sep 13 12:04:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:16.598657 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd693c46-feaf-4773-8e17-c718187c7517 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:16.727434 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd693c46-feaf-4773-8e17-c718187c7517 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:16.762641 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f22f90-2e3a-4764-9369-43425228645b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:16.763317 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f22f90-2e3a-4764-9369-43425228645b None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:16.763598 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f22f90-2e3a-4764-9369-43425228645b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:16.763862 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f22f90-2e3a-4764-9369-43425228645b None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:16.764514 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f22f90-2e3a-4764-9369-43425228645b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:16.764810 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f22f90-2e3a-4764-9369-43425228645b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:16.766151 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f22f90-2e3a-4764-9369-43425228645b None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:16.774788 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 217/421] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:16.780623 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ae56c-ed83-4996-848b-25ea05ebd02b None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:16.802638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f22f90-2e3a-4764-9369-43425228645b None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:16.860450 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:16.919142 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ae56c-ed83-4996-848b-25ea05ebd02b None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:16.955985 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c0c3d-6b6a-42e6-968e-8f54fd2ca5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:16.957006 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c0c3d-6b6a-42e6-968e-8f54fd2ca5cd None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:16.957377 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c0c3d-6b6a-42e6-968e-8f54fd2ca5cd None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:16.957655 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c0c3d-6b6a-42e6-968e-8f54fd2ca5cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:16.972786 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f22f90-2e3a-4764-9369-43425228645b None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:17.021276 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:17.041322 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c0c3d-6b6a-42e6-968e-8f54fd2ca5cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:17.042831 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c0c3d-6b6a-42e6-968e-8f54fd2ca5cd None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:17.067417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564681c-9669-484c-ad6a-c1e14ed28eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:17.068079 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564681c-9669-484c-ad6a-c1e14ed28eea None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:17.068361 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564681c-9669-484c-ad6a-c1e14ed28eea None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:17.068637 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564681c-9669-484c-ad6a-c1e14ed28eea None admin] PATH_INFO: `/v3/roles/member` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:17.094748 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564681c-9669-484c-ad6a-c1e14ed28eea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:17.100248 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-e564681c-9669-484c-ad6a-c1e14ed28eea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:04:17.100248 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:17.100248 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:17.100248 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:17.100248 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:17.100248 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:17.100248 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:17.100248 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:17.100248 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:17.100248 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:17.100248 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:17.100248 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:17.100248 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:17.100248 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:17.100248 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:17.100248 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:17.101144 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:17.101144 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:17.101144 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:17.101144 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:17.101144 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:17.101144 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:17.101144 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:17.101144 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:17.101144 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:17.101144 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:17.101144 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:17.101144 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:17.101144 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:17.101144 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:17.101144 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:17.101144 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:17.101934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:17.101934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:17.101934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:17.101934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:17.101934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:17.101934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:17.101934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:17.101934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:17.101934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:17.101934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:17.101934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:04:17.101934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:17.101934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 218/422] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:04:17.110607 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564681c-9669-484c-ad6a-c1e14ed28eea None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:17.194809 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 205/423] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:04:17.202902 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c0c3d-6b6a-42e6-968e-8f54fd2ca5cd None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:17.271896 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564681c-9669-484c-ad6a-c1e14ed28eea None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:17.283122 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:17.317644 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216123e-8933-421b-bfe5-4574ca31be4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:17.318581 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216123e-8933-421b-bfe5-4574ca31be4b None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:17.319122 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216123e-8933-421b-bfe5-4574ca31be4b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:17.324195 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216123e-8933-421b-bfe5-4574ca31be4b None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:17.325315 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216123e-8933-421b-bfe5-4574ca31be4b None admin] RBAC: Adding query filter params (name=member) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:17.326973 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216123e-8933-421b-bfe5-4574ca31be4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:17.331026 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216123e-8933-421b-bfe5-4574ca31be4b None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:17.343757 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:17.345360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 219/424] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:04:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:17.352152 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216123e-8933-421b-bfe5-4574ca31be4b None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:17.378582 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c0c3d-6b6a-42e6-968e-8f54fd2ca5cd None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:17.433943 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ed035-ad08-4547-a9bd-24ab71a263f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:17.434725 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ed035-ad08-4547-a9bd-24ab71a263f8 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:17.435004 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ed035-ad08-4547-a9bd-24ab71a263f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:17.435288 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ed035-ad08-4547-a9bd-24ab71a263f8 None admin] PATH_INFO: `/v3/projects/b8c35869b0184f978d0e9bb42b22ad27` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:17.436554 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ed035-ad08-4547-a9bd-24ab71a263f8 None admin] RBAC: Authorizing `identity:get_project(project_id=b8c35869b0184f978d0e9bb42b22ad27)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:17.438009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ed035-ad08-4547-a9bd-24ab71a263f8 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:17.440278 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 206/425] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:17 2022] GET /identity/v3/projects/b8c35869b0184f978d0e9bb42b22ad27 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:17.445873 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ed035-ad08-4547-a9bd-24ab71a263f8 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:17.601256 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ed035-ad08-4547-a9bd-24ab71a263f8 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:17.605199 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216123e-8933-421b-bfe5-4574ca31be4b None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:17.669176 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd431d20-521c-419e-a87e-29b80e716c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:17.669925 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd431d20-521c-419e-a87e-29b80e716c41 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:17.670221 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd431d20-521c-419e-a87e-29b80e716c41 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:17.670503 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd431d20-521c-419e-a87e-29b80e716c41 None admin] PATH_INFO: `/v3/groups/c835dd1157c847beba445175d736aeec` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:17.671740 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd431d20-521c-419e-a87e-29b80e716c41 None admin] RBAC: Authorizing `identity:get_group(group_id=c835dd1157c847beba445175d736aeec)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:17.672483 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35db86-c373-4667-b662-dbb749e2b56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:17.673406 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35db86-c373-4667-b662-dbb749e2b56f None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:17.673496 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd431d20-521c-419e-a87e-29b80e716c41 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:17.673596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35db86-c373-4667-b662-dbb749e2b56f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:17.674147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35db86-c373-4667-b662-dbb749e2b56f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:17.675000 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 207/426] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Sep 13 12:04:17 2022] GET /identity/v3/groups/c835dd1157c847beba445175d736aeec => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:17.699626 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd431d20-521c-419e-a87e-29b80e716c41 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:17.734584 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:17.742453 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:17.778889 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35db86-c373-4667-b662-dbb749e2b56f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:17.780348 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35db86-c373-4667-b662-dbb749e2b56f None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:17.848087 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd431d20-521c-419e-a87e-29b80e716c41 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:17.892737 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855a0d4-9e80-4535-99bf-0f56861a9413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:17.893367 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855a0d4-9e80-4535-99bf-0f56861a9413 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:17.893648 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855a0d4-9e80-4535-99bf-0f56861a9413 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:17.894027 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855a0d4-9e80-4535-99bf-0f56861a9413 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:17.894878 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855a0d4-9e80-4535-99bf-0f56861a9413 None admin] RBAC: Adding query filter params (group.id=c835dd1157c847beba445175d736aeec, role.id=f396be01985a422c96d757a4c77a1fb1, scope.project.id=b8c35869b0184f978d0e9bb42b22ad27) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:17.895261 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855a0d4-9e80-4535-99bf-0f56861a9413 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:17.897159 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855a0d4-9e80-4535-99bf-0f56861a9413 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:17.904111 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 208/427] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Sep 13 12:04:17 2022] GET /identity/v3/role_assignments?group.id=c835dd1157c847beba445175d736aeec&scope.project.id=b8c35869b0184f978d0e9bb42b22ad27&role.id=f396be01985a422c96d757a4c77a1fb1 => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:17.905339 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6ee49-f944-4d55-b318-74e687253b1e None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:17.905628 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6ee49-f944-4d55-b318-74e687253b1e None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:17.905903 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6ee49-f944-4d55-b318-74e687253b1e None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:17.907531 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 209/428] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:17.911123 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 220/429] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:04:17.913749 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5149fa9-642d-4af4-9e3d-ac70f95aa861 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:17.914017 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5149fa9-642d-4af4-9e3d-ac70f95aa861 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:17.914304 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5149fa9-642d-4af4-9e3d-ac70f95aa861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:17.917198 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35db86-c373-4667-b662-dbb749e2b56f None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:17.946128 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-c5149fa9-642d-4af4-9e3d-ac70f95aa861 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:17.947422 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-c5149fa9-642d-4af4-9e3d-ac70f95aa861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:18.071893 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:18.103623 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 210/430] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:18.130392 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35db86-c373-4667-b662-dbb749e2b56f None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:18.186077 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca230b86-640d-4450-8749-805fc3ea468c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:18.186641 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca230b86-640d-4450-8749-805fc3ea468c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:18.186903 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca230b86-640d-4450-8749-805fc3ea468c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:18.187174 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca230b86-640d-4450-8749-805fc3ea468c None admin] PATH_INFO: `/v3/projects/b8c35869b0184f978d0e9bb42b22ad27` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:18.191537 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca230b86-640d-4450-8749-805fc3ea468c None admin] RBAC: Authorizing `identity:get_project(project_id=b8c35869b0184f978d0e9bb42b22ad27)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:18.193120 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca230b86-640d-4450-8749-805fc3ea468c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:18.195543 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 221/431] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:17 2022] GET /identity/v3/projects/b8c35869b0184f978d0e9bb42b22ad27 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:18.200903 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5149fa9-642d-4af4-9e3d-ac70f95aa861 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:18.219750 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:18.324212 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5149fa9-642d-4af4-9e3d-ac70f95aa861 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:18.362092 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa0788-7c6f-4d6c-9efb-ec64a1c3a836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:18.362892 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa0788-7c6f-4d6c-9efb-ec64a1c3a836 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:18.363164 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa0788-7c6f-4d6c-9efb-ec64a1c3a836 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:18.363429 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa0788-7c6f-4d6c-9efb-ec64a1c3a836 None admin] PATH_INFO: `/v3/groups/c835dd1157c847beba445175d736aeec` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:18.364606 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa0788-7c6f-4d6c-9efb-ec64a1c3a836 None admin] RBAC: Authorizing `identity:get_group(group_id=c835dd1157c847beba445175d736aeec)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:18.366157 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa0788-7c6f-4d6c-9efb-ec64a1c3a836 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:18.368081 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 211/432] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Sep 13 12:04:18 2022] GET /identity/v3/groups/c835dd1157c847beba445175d736aeec => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:18.375727 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca230b86-640d-4450-8749-805fc3ea468c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:18.512432 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca230b86-640d-4450-8749-805fc3ea468c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:18.545233 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa0788-7c6f-4d6c-9efb-ec64a1c3a836 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:18.567971 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2a23c-fdac-48d6-bb47-7eb1766f4e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:18.568652 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2a23c-fdac-48d6-bb47-7eb1766f4e17 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:18.568933 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2a23c-fdac-48d6-bb47-7eb1766f4e17 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:18.569206 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2a23c-fdac-48d6-bb47-7eb1766f4e17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:18.569980 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2a23c-fdac-48d6-bb47-7eb1766f4e17 None admin] RBAC: Adding query filter params (group.id=c835dd1157c847beba445175d736aeec, role.id=ab14a68bf5b54561badd35b83e6acaf5, scope.project.id=b8c35869b0184f978d0e9bb42b22ad27) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:18.570293 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2a23c-fdac-48d6-bb47-7eb1766f4e17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:18.571973 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2a23c-fdac-48d6-bb47-7eb1766f4e17 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:18.578996 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 222/433] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Sep 13 12:04:18 2022] GET /identity/v3/role_assignments?group.id=c835dd1157c847beba445175d736aeec&scope.project.id=b8c35869b0184f978d0e9bb42b22ad27&role.id=ab14a68bf5b54561badd35b83e6acaf5 => generated 611 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:18.633369 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf949e-eefa-46a3-ba9b-54d3fb34e9e4 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:18.633689 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf949e-eefa-46a3-ba9b-54d3fb34e9e4 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:18.634042 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf949e-eefa-46a3-ba9b-54d3fb34e9e4 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:18.636044 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 223/434] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:04:18.641890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a24082-5da2-4938-94d4-34bb0a663ef3 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:18.642323 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a24082-5da2-4938-94d4-34bb0a663ef3 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:18.642720 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a24082-5da2-4938-94d4-34bb0a663ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:18.651905 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:18.671381 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-91a24082-5da2-4938-94d4-34bb0a663ef3 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:18.673233 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-91a24082-5da2-4938-94d4-34bb0a663ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:18.683024 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:18.686145 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa0788-7c6f-4d6c-9efb-ec64a1c3a836 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:18.747473 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2607ac-978d-4eda-956a-9e5b237fdd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:18.748612 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2607ac-978d-4eda-956a-9e5b237fdd1f None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:18.749922 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2607ac-978d-4eda-956a-9e5b237fdd1f None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:18.750422 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2607ac-978d-4eda-956a-9e5b237fdd1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:18.768434 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2607ac-978d-4eda-956a-9e5b237fdd1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:18.776447 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-1f2607ac-978d-4eda-956a-9e5b237fdd1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:04:18.776447 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:18.776447 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:18.776447 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:18.776447 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:18.776447 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:18.776447 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:18.776447 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:18.776447 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:18.776447 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:18.776447 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:18.776447 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:18.776447 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:18.776447 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:18.776447 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:18.776447 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:18.777437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:18.777437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:18.777437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:18.777437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:18.777437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:18.777437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:18.777437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:18.777437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:18.777437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:18.777437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:18.777437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:18.777437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:18.777437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:18.777437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:18.777437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:18.777437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:18.778334 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:18.778334 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:18.778334 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:18.778334 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:18.778334 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:18.778334 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:18.778334 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:18.778334 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:18.778334 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:18.778334 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:18.778334 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 12:04:18.778334 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:18.783363 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 212/435] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:04:18.787886 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2607ac-978d-4eda-956a-9e5b237fdd1f None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:18.806677 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 224/436] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:18.908395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b9495-f8f2-41eb-87fa-370189cad2c3 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:18.909062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2607ac-978d-4eda-956a-9e5b237fdd1f None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:18.909304 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b9495-f8f2-41eb-87fa-370189cad2c3 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:18.909582 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b9495-f8f2-41eb-87fa-370189cad2c3 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:18.912309 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 225/437] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:04:18.918443 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c18bc5-2fb2-4a95-890b-829edee54690 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:18.918745 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c18bc5-2fb2-4a95-890b-829edee54690 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:18.919065 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c18bc5-2fb2-4a95-890b-829edee54690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:18.939800 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-03c18bc5-2fb2-4a95-890b-829edee54690 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:18.941020 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-03c18bc5-2fb2-4a95-890b-829edee54690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:18.958182 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddcf9e-1695-431c-afc9-8b4450d8bc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:18.958880 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddcf9e-1695-431c-afc9-8b4450d8bc42 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:18.959159 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddcf9e-1695-431c-afc9-8b4450d8bc42 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:18.959430 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddcf9e-1695-431c-afc9-8b4450d8bc42 None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:18.960106 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ddcf9e-1695-431c-afc9-8b4450d8bc42 None admin] RBAC: Adding query filter params (name=member) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:18.960397 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ddcf9e-1695-431c-afc9-8b4450d8bc42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:18.961773 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ddcf9e-1695-431c-afc9-8b4450d8bc42 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:18.971585 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 213/438] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:04:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:18.979865 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddcf9e-1695-431c-afc9-8b4450d8bc42 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:18.994934 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:19.019498 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 226/439] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:19.123907 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddcf9e-1695-431c-afc9-8b4450d8bc42 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:19.149936 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c18bc5-2fb2-4a95-890b-829edee54690 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:19.170660 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23e593-4cb9-48d4-a806-2eaad55a9c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:19.171564 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23e593-4cb9-48d4-a806-2eaad55a9c7d None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:19.171986 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23e593-4cb9-48d4-a806-2eaad55a9c7d None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:19.172385 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23e593-4cb9-48d4-a806-2eaad55a9c7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:19.246206 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:19.265141 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23e593-4cb9-48d4-a806-2eaad55a9c7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:19.266606 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23e593-4cb9-48d4-a806-2eaad55a9c7d None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:19.271311 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:19.304585 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c18bc5-2fb2-4a95-890b-829edee54690 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:19.359413 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7468015-91b8-40c8-b30c-a433c5a2c412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:19.360074 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7468015-91b8-40c8-b30c-a433c5a2c412 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:19.360353 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7468015-91b8-40c8-b30c-a433c5a2c412 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:19.360627 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7468015-91b8-40c8-b30c-a433c5a2c412 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:19.376141 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7468015-91b8-40c8-b30c-a433c5a2c412 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:19.382565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-c7468015-91b8-40c8-b30c-a433c5a2c412 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:04:19.382565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:19.382565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:19.382565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:19.382565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:19.382565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:19.382565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:19.382565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:19.382565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:19.382565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:19.382565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:19.382565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:19.382565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:19.382565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:19.382565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:19.382565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:19.383729 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:19.383729 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:19.383729 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:19.383729 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:19.383729 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:19.383729 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:19.383729 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:19.383729 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:19.383729 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:19.383729 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:19.383729 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:19.383729 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:19.383729 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:19.383729 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:19.383729 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:19.383729 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:19.384527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:19.384527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:19.384527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:19.384527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:19.384527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:19.384527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:19.384527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:19.384527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:19.384527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:19.384527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:19.384527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 12:04:19.384527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:19.384527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 227/440] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Sep 13 12:04:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:04:19.385167 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7468015-91b8-40c8-b30c-a433c5a2c412 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:19.413471 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 214/441] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:04:19.414505 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23e593-4cb9-48d4-a806-2eaad55a9c7d None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:19.504293 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7468015-91b8-40c8-b30c-a433c5a2c412 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:19.524122 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23e593-4cb9-48d4-a806-2eaad55a9c7d None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:19.526858 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:19.528648 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:19.541742 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de094dd-e1c5-4672-8c0d-1652e1e648f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:19.542385 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de094dd-e1c5-4672-8c0d-1652e1e648f6 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:19.542694 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de094dd-e1c5-4672-8c0d-1652e1e648f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:19.542970 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de094dd-e1c5-4672-8c0d-1652e1e648f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:19.554477 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de094dd-e1c5-4672-8c0d-1652e1e648f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:19.559359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-6de094dd-e1c5-4672-8c0d-1652e1e648f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:19.559359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:19.559359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:19.559359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:19.559359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:19.559359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:19.559359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:19.559359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:19.559359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:19.559359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:19.559359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:19.559359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:19.559359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:19.559359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:19.559359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:19.559359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:19.560457 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:19.560457 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:19.560457 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:19.560457 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:19.560457 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:19.560457 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:19.560457 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:19.560457 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:19.560457 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:19.560457 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:19.560457 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:19.560457 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:19.560457 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:19.560457 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:19.560457 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:19.560457 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:19.561352 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:19.561352 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:19.561352 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:19.561352 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:19.561352 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:19.561352 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:19.561352 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:19.561352 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:19.561352 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:19.561352 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:19.561352 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:19.561352 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:19.561352 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 228/442] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Sep 13 12:04:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:19.561352 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de094dd-e1c5-4672-8c0d-1652e1e648f6 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:19.572032 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96ae8d-31c7-429b-a243-e8e9430b5c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:19.572639 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96ae8d-31c7-429b-a243-e8e9430b5c08 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:19.572917 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96ae8d-31c7-429b-a243-e8e9430b5c08 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:19.573187 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96ae8d-31c7-429b-a243-e8e9430b5c08 None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:19.573852 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96ae8d-31c7-429b-a243-e8e9430b5c08 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:19.574153 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96ae8d-31c7-429b-a243-e8e9430b5c08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:19.575575 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96ae8d-31c7-429b-a243-e8e9430b5c08 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:19.585094 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 215/443] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:19.586151 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96ae8d-31c7-429b-a243-e8e9430b5c08 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:19.674493 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de094dd-e1c5-4672-8c0d-1652e1e648f6 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:19.699188 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96ae8d-31c7-429b-a243-e8e9430b5c08 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:19.709644 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42220eb-291b-4aed-81c1-53293c60b975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:19.710275 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42220eb-291b-4aed-81c1-53293c60b975 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:19.710553 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42220eb-291b-4aed-81c1-53293c60b975 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:19.710851 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42220eb-291b-4aed-81c1-53293c60b975 None admin] PATH_INFO: `/v3/projects/85323b48b377409bb1a44ca2c635e0c4` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:19.711973 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42220eb-291b-4aed-81c1-53293c60b975 None admin] RBAC: Authorizing `identity:get_project(project_id=85323b48b377409bb1a44ca2c635e0c4)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:19.713406 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42220eb-291b-4aed-81c1-53293c60b975 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:19.715051 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 229/444] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:19 2022] GET /identity/v3/projects/85323b48b377409bb1a44ca2c635e0c4 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:19.715817 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42220eb-291b-4aed-81c1-53293c60b975 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:19.733455 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547f67b-91eb-4273-ba32-e3ed47d7c007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:19.734055 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547f67b-91eb-4273-ba32-e3ed47d7c007 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:19.734328 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547f67b-91eb-4273-ba32-e3ed47d7c007 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:19.734597 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547f67b-91eb-4273-ba32-e3ed47d7c007 None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:19.735286 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547f67b-91eb-4273-ba32-e3ed47d7c007 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:19.735589 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547f67b-91eb-4273-ba32-e3ed47d7c007 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:19.737536 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547f67b-91eb-4273-ba32-e3ed47d7c007 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:19.745840 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 216/445] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:19.751199 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547f67b-91eb-4273-ba32-e3ed47d7c007 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:19.775631 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:19.777032 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:19.832439 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42220eb-291b-4aed-81c1-53293c60b975 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:19.853065 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547f67b-91eb-4273-ba32-e3ed47d7c007 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:19.869712 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efaf2d6-c154-47ba-b962-ec2e4a794423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:19.870324 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efaf2d6-c154-47ba-b962-ec2e4a794423 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:19.870604 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efaf2d6-c154-47ba-b962-ec2e4a794423 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:19.870896 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efaf2d6-c154-47ba-b962-ec2e4a794423 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:19.889881 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd77866-18e4-471f-a466-ab43bfd2b273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:19.890509 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd77866-18e4-471f-a466-ab43bfd2b273 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:19.890822 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd77866-18e4-471f-a466-ab43bfd2b273 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:19.891095 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd77866-18e4-471f-a466-ab43bfd2b273 None admin] PATH_INFO: `/v3/groups/c835dd1157c847beba445175d736aeec` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:19.892418 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd77866-18e4-471f-a466-ab43bfd2b273 None admin] RBAC: Authorizing `identity:get_group(group_id=c835dd1157c847beba445175d736aeec)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:19.893886 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd77866-18e4-471f-a466-ab43bfd2b273 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:19.895512 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 217/446] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Sep 13 12:04:19 2022] GET /identity/v3/groups/c835dd1157c847beba445175d736aeec => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:19.896287 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd77866-18e4-471f-a466-ab43bfd2b273 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:19.944302 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efaf2d6-c154-47ba-b962-ec2e4a794423 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:19.945804 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efaf2d6-c154-47ba-b962-ec2e4a794423 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:19.994360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:20.003327 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:20.010285 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd77866-18e4-471f-a466-ab43bfd2b273 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:20.047910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536e4ac-a373-4127-9505-8a84f1dad7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:20.048556 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536e4ac-a373-4127-9505-8a84f1dad7b6 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:20.048832 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536e4ac-a373-4127-9505-8a84f1dad7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:20.049119 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536e4ac-a373-4127-9505-8a84f1dad7b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:20.059639 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 230/447] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:04:20.060485 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efaf2d6-c154-47ba-b962-ec2e4a794423 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:20.136482 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8536e4ac-a373-4127-9505-8a84f1dad7b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:20.136482 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8536e4ac-a373-4127-9505-8a84f1dad7b6 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:20.164735 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efaf2d6-c154-47ba-b962-ec2e4a794423 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:20.204451 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dad03-88f4-43cf-a373-cc4437ad4616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:20.205584 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dad03-88f4-43cf-a373-cc4437ad4616 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:20.205859 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dad03-88f4-43cf-a373-cc4437ad4616 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:20.206129 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781dad03-88f4-43cf-a373-cc4437ad4616 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:20.206887 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781dad03-88f4-43cf-a373-cc4437ad4616 None admin] RBAC: Adding query filter params (group.id=c835dd1157c847beba445175d736aeec, role.id=ab14a68bf5b54561badd35b83e6acaf5, scope.project.id=85323b48b377409bb1a44ca2c635e0c4) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:20.207194 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781dad03-88f4-43cf-a373-cc4437ad4616 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:20.208621 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781dad03-88f4-43cf-a373-cc4437ad4616 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:20.214430 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 231/448] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Sep 13 12:04:20 2022] GET /identity/v3/role_assignments?group.id=c835dd1157c847beba445175d736aeec&scope.project.id=85323b48b377409bb1a44ca2c635e0c4&role.id=ab14a68bf5b54561badd35b83e6acaf5 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:20.215237 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dad03-88f4-43cf-a373-cc4437ad4616 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:20.233030 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:20.248105 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:20.256608 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 218/449] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:04:20.262647 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536e4ac-a373-4127-9505-8a84f1dad7b6 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:20.336866 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781dad03-88f4-43cf-a373-cc4437ad4616 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:20.383733 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7affa79-8bdb-47cd-ba60-a4770cee6cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:20.384395 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536e4ac-a373-4127-9505-8a84f1dad7b6 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:20.384513 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7affa79-8bdb-47cd-ba60-a4770cee6cd3 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:20.384729 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7affa79-8bdb-47cd-ba60-a4770cee6cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:20.384908 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7affa79-8bdb-47cd-ba60-a4770cee6cd3 None admin] PATH_INFO: `/v3/projects/85323b48b377409bb1a44ca2c635e0c4` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:20.386105 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7affa79-8bdb-47cd-ba60-a4770cee6cd3 None admin] RBAC: Authorizing `identity:get_project(project_id=85323b48b377409bb1a44ca2c635e0c4)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:20.387591 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7affa79-8bdb-47cd-ba60-a4770cee6cd3 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:20.389263 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 232/450] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:20 2022] GET /identity/v3/projects/85323b48b377409bb1a44ca2c635e0c4 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:20.395932 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7affa79-8bdb-47cd-ba60-a4770cee6cd3 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:20.429036 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d4ad3-ed12-4d58-8b42-dd790cfbd530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:20.429508 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d4ad3-ed12-4d58-8b42-dd790cfbd530 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:20.430798 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d4ad3-ed12-4d58-8b42-dd790cfbd530 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:20.430798 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d4ad3-ed12-4d58-8b42-dd790cfbd530 None admin] PATH_INFO: `/v3/projects/99ef8d30db4a4918b2622d7bdad47c3e` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:20.432644 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d4ad3-ed12-4d58-8b42-dd790cfbd530 None admin] RBAC: Authorizing `identity:get_project(project_id=99ef8d30db4a4918b2622d7bdad47c3e)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:20.433163 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d4ad3-ed12-4d58-8b42-dd790cfbd530 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:20.435442 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 219/451] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Sep 13 12:04:20 2022] GET /identity/v3/projects/99ef8d30db4a4918b2622d7bdad47c3e => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:20.441378 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d4ad3-ed12-4d58-8b42-dd790cfbd530 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:20.497471 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:20.517717 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:20.530412 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7affa79-8bdb-47cd-ba60-a4770cee6cd3 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:20.572053 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d4ad3-ed12-4d58-8b42-dd790cfbd530 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:20.576434 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2166a93-b0ae-44d6-a02f-508801307b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:20.577114 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2166a93-b0ae-44d6-a02f-508801307b4a None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:20.577390 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2166a93-b0ae-44d6-a02f-508801307b4a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:20.577658 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2166a93-b0ae-44d6-a02f-508801307b4a None admin] PATH_INFO: `/v3/groups/c835dd1157c847beba445175d736aeec` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:20.578864 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2166a93-b0ae-44d6-a02f-508801307b4a None admin] RBAC: Authorizing `identity:get_group(group_id=c835dd1157c847beba445175d736aeec)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:20.580971 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2166a93-b0ae-44d6-a02f-508801307b4a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:20.583017 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 233/452] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Sep 13 12:04:20 2022] GET /identity/v3/groups/c835dd1157c847beba445175d736aeec => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:20.589444 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2166a93-b0ae-44d6-a02f-508801307b4a None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:20.627335 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591445bc-7db9-4548-a619-e94eaeaf88c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:20.628260 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591445bc-7db9-4548-a619-e94eaeaf88c9 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:20.628538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591445bc-7db9-4548-a619-e94eaeaf88c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:20.628805 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591445bc-7db9-4548-a619-e94eaeaf88c9 None admin] PATH_INFO: `/v3/groups/66d4d7c92045421ca5919ce38bf5562e` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:20.630008 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591445bc-7db9-4548-a619-e94eaeaf88c9 None admin] RBAC: Authorizing `identity:get_group(group_id=66d4d7c92045421ca5919ce38bf5562e)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:20.631538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591445bc-7db9-4548-a619-e94eaeaf88c9 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:20.633127 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 220/453] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Sep 13 12:04:20 2022] GET /identity/v3/groups/66d4d7c92045421ca5919ce38bf5562e => generated 229 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:20.639659 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591445bc-7db9-4548-a619-e94eaeaf88c9 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:20.721083 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2166a93-b0ae-44d6-a02f-508801307b4a None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:20.758679 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7674f-3b55-4815-97aa-8da12cdd7471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:20.759359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7674f-3b55-4815-97aa-8da12cdd7471 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:20.759633 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7674f-3b55-4815-97aa-8da12cdd7471 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:20.759910 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7674f-3b55-4815-97aa-8da12cdd7471 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:20.760629 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7674f-3b55-4815-97aa-8da12cdd7471 None admin] RBAC: Adding query filter params (group.id=c835dd1157c847beba445175d736aeec, role.id=f396be01985a422c96d757a4c77a1fb1, scope.project.id=85323b48b377409bb1a44ca2c635e0c4) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:20.761017 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7674f-3b55-4815-97aa-8da12cdd7471 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:20.762422 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7674f-3b55-4815-97aa-8da12cdd7471 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:20.764568 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591445bc-7db9-4548-a619-e94eaeaf88c9 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:20.770210 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 234/454] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Sep 13 12:04:20 2022] GET /identity/v3/role_assignments?group.id=c835dd1157c847beba445175d736aeec&scope.project.id=85323b48b377409bb1a44ca2c635e0c4&role.id=f396be01985a422c96d757a4c77a1fb1 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:20.800039 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:20.805465 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b818d-b067-4168-8444-043f9623306e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:20.806089 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b818d-b067-4168-8444-043f9623306e None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:20.806370 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b818d-b067-4168-8444-043f9623306e None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:20.806676 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b818d-b067-4168-8444-043f9623306e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:20.807427 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b818d-b067-4168-8444-043f9623306e None admin] RBAC: Adding query filter params (group.id=66d4d7c92045421ca5919ce38bf5562e, role.id=5609ac7373ba400593bba6d811e3aa72, scope.project.id=99ef8d30db4a4918b2622d7bdad47c3e) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:20.807739 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b818d-b067-4168-8444-043f9623306e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:20.809215 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b818d-b067-4168-8444-043f9623306e None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:20.816987 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 221/455] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Sep 13 12:04:20 2022] GET /identity/v3/role_assignments?group.id=66d4d7c92045421ca5919ce38bf5562e&scope.project.id=99ef8d30db4a4918b2622d7bdad47c3e&role.id=5609ac7373ba400593bba6d811e3aa72 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:23.875189 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf42625-b50c-4c6d-bf6c-c2d11f3e03c3 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:23.875728 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf42625-b50c-4c6d-bf6c-c2d11f3e03c3 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:23.875728 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf42625-b50c-4c6d-bf6c-c2d11f3e03c3 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:23.877494 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 235/456] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:23.883406 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aebc25-f162-4699-8b3f-77d7d7f2e9ad None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:23.883877 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aebc25-f162-4699-8b3f-77d7d7f2e9ad None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:23.883976 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aebc25-f162-4699-8b3f-77d7d7f2e9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:23.903565 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-07aebc25-f162-4699-8b3f-77d7d7f2e9ad None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:23.904769 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-07aebc25-f162-4699-8b3f-77d7d7f2e9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:23.976271 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 222/457] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:04:24.259527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b147ef-180e-495f-aa94-b90bc47c08c1 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:24.259714 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b147ef-180e-495f-aa94-b90bc47c08c1 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:24.259986 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b147ef-180e-495f-aa94-b90bc47c08c1 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:24.261577 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 236/458] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:24.267277 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0091a-1ec9-4a7f-9c19-9740cc021e2f None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:24.267761 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0091a-1ec9-4a7f-9c19-9740cc021e2f None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:24.268145 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0091a-1ec9-4a7f-9c19-9740cc021e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:24.287275 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-eaf0091a-1ec9-4a7f-9c19-9740cc021e2f None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:24.288465 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-eaf0091a-1ec9-4a7f-9c19-9740cc021e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:24.315132 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b147ef-180e-495f-aa94-b90bc47c08c1 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:24.331944 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:24.370048 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 223/459] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:24.435119 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b147ef-180e-495f-aa94-b90bc47c08c1 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:24.474588 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed567be-f3aa-4ccc-a878-36e058de7b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:24.475256 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed567be-f3aa-4ccc-a878-36e058de7b76 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:24.475536 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed567be-f3aa-4ccc-a878-36e058de7b76 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:24.475809 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed567be-f3aa-4ccc-a878-36e058de7b76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:24.488411 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed567be-f3aa-4ccc-a878-36e058de7b76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:24.490053 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed567be-f3aa-4ccc-a878-36e058de7b76 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:24.495298 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31688b-2ef9-405c-bcd5-8a2c464f84d6 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:24.495582 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31688b-2ef9-405c-bcd5-8a2c464f84d6 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:24.495855 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31688b-2ef9-405c-bcd5-8a2c464f84d6 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:24.497193 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 224/460] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:04:24.503167 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeacb61-dcce-444a-a953-07a4e0803fd8 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:24.503475 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeacb61-dcce-444a-a953-07a4e0803fd8 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:24.503935 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeacb61-dcce-444a-a953-07a4e0803fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:24.511776 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-7ed567be-f3aa-4ccc-a878-36e058de7b76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:24.511776 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:24.511776 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:24.511776 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:24.511776 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:24.511776 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:24.511776 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:24.511776 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:24.511776 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:24.511776 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:24.511776 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:24.511776 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:24.511776 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:24.511776 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:24.511776 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:24.511776 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:24.513154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:24.513154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:24.513154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:24.513154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:24.513154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:24.513154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:24.513154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:24.513154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:24.513154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:24.513154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:24.513154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:24.513154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:24.513154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:24.513154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:24.513154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:24.513154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:24.513154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:24.514337 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:24.514337 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:24.514337 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:24.514337 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 237/461] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:24.522601 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed567be-f3aa-4ccc-a878-36e058de7b76 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:24.538126 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-abeacb61-dcce-444a-a953-07a4e0803fd8 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:24.539344 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-abeacb61-dcce-444a-a953-07a4e0803fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:24.606856 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:24.607953 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:24.628235 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 225/462] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:04:24.640674 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe180bc-6eee-409f-96da-a99a16e431db None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:24.641089 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe180bc-6eee-409f-96da-a99a16e431db None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:24.641377 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe180bc-6eee-409f-96da-a99a16e431db None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:24.643663 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 226/463] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:24.648946 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279324d6-9118-48ab-b35e-93d0db0b72f5 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:24.649218 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279324d6-9118-48ab-b35e-93d0db0b72f5 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:24.649494 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279324d6-9118-48ab-b35e-93d0db0b72f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:24.655561 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed567be-f3aa-4ccc-a878-36e058de7b76 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:24.676081 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-279324d6-9118-48ab-b35e-93d0db0b72f5 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:24.677280 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-279324d6-9118-48ab-b35e-93d0db0b72f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:24.714366 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a17e3e-4fc5-4726-9452-a36a85fff1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:24.715551 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a17e3e-4fc5-4726-9452-a36a85fff1d5 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:24.715999 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a17e3e-4fc5-4726-9452-a36a85fff1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:24.716410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a17e3e-4fc5-4726-9452-a36a85fff1d5 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:24.717516 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a17e3e-4fc5-4726-9452-a36a85fff1d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:24.718083 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a17e3e-4fc5-4726-9452-a36a85fff1d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:24.719951 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a17e3e-4fc5-4726-9452-a36a85fff1d5 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:24.737450 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 238/464] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:24.738736 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a17e3e-4fc5-4726-9452-a36a85fff1d5 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:24.755822 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 227/465] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:04:24.756886 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279324d6-9118-48ab-b35e-93d0db0b72f5 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:24.868988 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a17e3e-4fc5-4726-9452-a36a85fff1d5 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:24.890981 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279324d6-9118-48ab-b35e-93d0db0b72f5 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:24.911001 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:24.920800 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a16165-9255-4181-8a17-50e472d01ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:24.922313 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a16165-9255-4181-8a17-50e472d01ab0 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:24.923052 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a16165-9255-4181-8a17-50e472d01ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:24.924736 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a16165-9255-4181-8a17-50e472d01ab0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:24.932574 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e764a-e134-4f52-bc08-e9017c11797d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:24.933494 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e764a-e134-4f52-bc08-e9017c11797d None admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:24.934020 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e764a-e134-4f52-bc08-e9017c11797d None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:24.934582 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e764a-e134-4f52-bc08-e9017c11797d None admin] PATH_INFO: `/v3/users` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:24.935475 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e764a-e134-4f52-bc08-e9017c11797d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:24.937462 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e764a-e134-4f52-bc08-e9017c11797d None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:24.939245 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a16165-9255-4181-8a17-50e472d01ab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:24.940897 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a16165-9255-4181-8a17-50e472d01ab0 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:24.953817 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:24.962356 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-31a16165-9255-4181-8a17-50e472d01ab0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:24.962356 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:24.962356 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:24.962356 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:24.962356 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:24.962356 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:24.962356 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:24.962356 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:24.962356 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:24.962356 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:24.962356 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:24.962356 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:24.962356 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:24.962356 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:24.962356 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:24.962356 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:24.963355 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:24.963355 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:24.963355 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:24.963355 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:24.963355 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:24.963355 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:24.963355 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:24.963355 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:24.963355 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:24.963355 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:24.963355 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:24.963355 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:24.963355 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:24.963355 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:24.963355 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:24.963355 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:24.963355 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:24.964226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:24.964226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:24.964226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:24.964226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 239/466] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:24.974782 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 228/467] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Sep 13 12:04:24 2022] POST /identity/v3/users => generated 246 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:04:24.976022 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a16165-9255-4181-8a17-50e472d01ab0 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:24.988282 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e764a-e134-4f52-bc08-e9017c11797d None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:25.136619 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a16165-9255-4181-8a17-50e472d01ab0 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:25.138897 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e764a-e134-4f52-bc08-e9017c11797d None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:25.184046 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc63fe-c5e8-4b2c-a1cf-34d814a81702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:25.184737 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc63fe-c5e8-4b2c-a1cf-34d814a81702 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:25.185019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc63fe-c5e8-4b2c-a1cf-34d814a81702 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:25.185331 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc63fe-c5e8-4b2c-a1cf-34d814a81702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:25.185788 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65703030-da5e-4303-a21c-ab982def3486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:25.186567 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65703030-da5e-4303-a21c-ab982def3486 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:25.187050 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65703030-da5e-4303-a21c-ab982def3486 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:25.187580 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65703030-da5e-4303-a21c-ab982def3486 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:25.188499 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65703030-da5e-4303-a21c-ab982def3486 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:25.189351 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65703030-da5e-4303-a21c-ab982def3486 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:25.190769 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65703030-da5e-4303-a21c-ab982def3486 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:25.197765 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc63fe-c5e8-4b2c-a1cf-34d814a81702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:25.199210 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc63fe-c5e8-4b2c-a1cf-34d814a81702 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:25.206778 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 240/468] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:25.208196 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65703030-da5e-4303-a21c-ab982def3486 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:25.219678 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-4fbc63fe-c5e8-4b2c-a1cf-34d814a81702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:25.219678 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:25.219678 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:25.219678 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:25.219678 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:25.219678 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:25.219678 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:25.219678 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:25.219678 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:25.219678 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:25.219678 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:25.219678 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:25.219678 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:25.219678 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:25.219678 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:25.219678 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:25.220652 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:25.220652 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:25.220652 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:25.220652 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:25.220652 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:25.220652 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:25.220652 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:25.220652 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:25.220652 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:25.220652 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:25.220652 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:25.220652 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:25.220652 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:25.220652 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:25.220652 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:25.220652 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:25.220652 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:25.221636 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:25.221636 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:25.221636 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:25.221636 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 229/469] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:25.222141 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc63fe-c5e8-4b2c-a1cf-34d814a81702 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:25.257354 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:25.258732 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:25.320796 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65703030-da5e-4303-a21c-ab982def3486 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:25.347759 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc63fe-c5e8-4b2c-a1cf-34d814a81702 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:25.360072 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad25fb-37a2-49d6-85bb-7179960ccd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:25.360721 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad25fb-37a2-49d6-85bb-7179960ccd9e None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:25.361485 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad25fb-37a2-49d6-85bb-7179960ccd9e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:25.361794 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad25fb-37a2-49d6-85bb-7179960ccd9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:25.372342 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad25fb-37a2-49d6-85bb-7179960ccd9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:25.373771 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad25fb-37a2-49d6-85bb-7179960ccd9e None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:25.386285 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2a391-27cd-40f0-bd95-bad4329972f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:25.387172 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2a391-27cd-40f0-bd95-bad4329972f9 None admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:25.387618 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2a391-27cd-40f0-bd95-bad4329972f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:25.388030 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2a391-27cd-40f0-bd95-bad4329972f9 None admin] PATH_INFO: `/v3/users` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:25.388815 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-f1ad25fb-37a2-49d6-85bb-7179960ccd9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:25.388815 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:25.388815 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:25.388815 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:25.388815 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:25.388815 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:25.388815 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:25.388815 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:25.388815 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:25.388815 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:25.388815 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:25.388815 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:25.388815 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:25.388815 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:25.388815 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:25.388815 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:25.389878 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:25.389878 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:25.389878 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:25.389878 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:25.389878 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:25.389878 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:25.389878 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:25.389878 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:25.389878 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:25.389878 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:25.389878 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:25.389878 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:25.389878 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:25.389878 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:25.389878 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:25.389878 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:25.389878 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:25.390958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:25.390958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:25.390958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:25.390958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 241/470] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:25.390958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad25fb-37a2-49d6-85bb-7179960ccd9e None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:25.391597 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2a391-27cd-40f0-bd95-bad4329972f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:25.394628 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2a391-27cd-40f0-bd95-bad4329972f9 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:25.419825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 230/471] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Sep 13 12:04:25 2022] POST /identity/v3/users => generated 248 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:04:25.427689 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2a391-27cd-40f0-bd95-bad4329972f9 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:25.504048 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:25.517492 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad25fb-37a2-49d6-85bb-7179960ccd9e None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:25.561768 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:25.576605 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a221e-d2f9-4027-8279-23246e5482e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:25.577228 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a221e-d2f9-4027-8279-23246e5482e0 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:25.577506 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a221e-d2f9-4027-8279-23246e5482e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:25.577773 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a221e-d2f9-4027-8279-23246e5482e0 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:25.579014 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a221e-d2f9-4027-8279-23246e5482e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:25.579014 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a221e-d2f9-4027-8279-23246e5482e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:25.581090 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a221e-d2f9-4027-8279-23246e5482e0 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:25.597183 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2a391-27cd-40f0-bd95-bad4329972f9 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:25.602571 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 242/472] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:25.610881 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a221e-d2f9-4027-8279-23246e5482e0 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:25.645762 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e08e01-f9bd-4e88-a7f2-3a7e65e93a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:25.646304 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e08e01-f9bd-4e88-a7f2-3a7e65e93a8d None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:25.646587 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e08e01-f9bd-4e88-a7f2-3a7e65e93a8d None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:25.646894 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e08e01-f9bd-4e88-a7f2-3a7e65e93a8d None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:25.647614 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e08e01-f9bd-4e88-a7f2-3a7e65e93a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:25.647927 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e08e01-f9bd-4e88-a7f2-3a7e65e93a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:25.649335 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e08e01-f9bd-4e88-a7f2-3a7e65e93a8d None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:25.672187 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 231/473] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:25.677720 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e08e01-f9bd-4e88-a7f2-3a7e65e93a8d None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:25.744304 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a221e-d2f9-4027-8279-23246e5482e0 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:25.785693 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437618b-48d6-48b6-a3dd-6a440394110b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:25.786306 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437618b-48d6-48b6-a3dd-6a440394110b None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:25.786588 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437618b-48d6-48b6-a3dd-6a440394110b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:25.786920 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437618b-48d6-48b6-a3dd-6a440394110b None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:25.787574 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437618b-48d6-48b6-a3dd-6a440394110b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:25.789001 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437618b-48d6-48b6-a3dd-6a440394110b None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:25.808080 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e08e01-f9bd-4e88-a7f2-3a7e65e93a8d None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:25.817779 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 243/474] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Sep 13 12:04:25 2022] POST /identity/v3/users => generated 248 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:04:25.850331 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c950513-c8f9-4510-8700-c577c717aaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:25.851003 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c950513-c8f9-4510-8700-c577c717aaa2 None admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:25.851283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c950513-c8f9-4510-8700-c577c717aaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:25.851566 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c950513-c8f9-4510-8700-c577c717aaa2 None admin] PATH_INFO: `/v3/users` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:25.852232 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c950513-c8f9-4510-8700-c577c717aaa2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:25.853844 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c950513-c8f9-4510-8700-c577c717aaa2 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:25.866336 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:25.883722 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 232/475] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Sep 13 12:04:25 2022] POST /identity/v3/users => generated 249 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:04:27.616243 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f43daa-ab9d-4ad6-8c39-8dc99926d0d1 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:27.616764 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f43daa-ab9d-4ad6-8c39-8dc99926d0d1 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:27.616872 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f43daa-ab9d-4ad6-8c39-8dc99926d0d1 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:27.618440 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 244/476] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:27.624542 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0a8e1-3764-417d-ad1c-700f673f5bea None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:27.625054 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0a8e1-3764-417d-ad1c-700f673f5bea None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:27.625126 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0a8e1-3764-417d-ad1c-700f673f5bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:27.647171 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-71c0a8e1-3764-417d-ad1c-700f673f5bea None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:27.648437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-71c0a8e1-3764-417d-ad1c-700f673f5bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:27.734827 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 233/477] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:28.070838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f43daa-ab9d-4ad6-8c39-8dc99926d0d1 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:28.083286 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:28.086206 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e475e-3e6b-4154-8539-f31a2f85fa0b None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:28.086494 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e475e-3e6b-4154-8539-f31a2f85fa0b None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:28.086802 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e475e-3e6b-4154-8539-f31a2f85fa0b None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:28.088488 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 234/478] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:28.098502 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a493284-d576-4207-a91a-d6fd9381efc2 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:28.098958 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a493284-d576-4207-a91a-d6fd9381efc2 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:28.099347 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a493284-d576-4207-a91a-d6fd9381efc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:28.124037 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-2a493284-d576-4207-a91a-d6fd9381efc2 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:28.125479 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-2a493284-d576-4207-a91a-d6fd9381efc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:28.209224 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f43daa-ab9d-4ad6-8c39-8dc99926d0d1 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:28.218142 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 235/479] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:28.249361 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a1de6-3cdb-4f86-8808-79158441aa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:28.250406 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a1de6-3cdb-4f86-8808-79158441aa4e None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:28.250870 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a1de6-3cdb-4f86-8808-79158441aa4e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:28.251387 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a1de6-3cdb-4f86-8808-79158441aa4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:28.263175 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a1de6-3cdb-4f86-8808-79158441aa4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:28.269218 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-775a1de6-3cdb-4f86-8808-79158441aa4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:04:28.269218 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:28.269218 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:28.269218 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:28.269218 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:28.269218 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:28.269218 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:28.269218 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:28.269218 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:28.269218 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:28.269218 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:28.269218 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:28.269218 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:28.269218 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:28.269218 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:28.269218 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:28.270377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:28.270377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:28.270377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:28.270377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:28.270377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:28.270377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:28.270377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:28.270377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:28.270377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:28.270377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:28.270377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:28.270377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:28.270377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:28.270377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:28.270377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:28.270377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:28.271437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:28.271437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:28.271437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:28.271437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:28.271437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:28.271437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:28.271437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:28.271437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:28.271437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:28.271437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:28.271437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:04:28.271437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:28.273759 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 245/480] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Sep 13 12:04:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:28.282657 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a493284-d576-4207-a91a-d6fd9381efc2 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:28.349866 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:28.397443 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a493284-d576-4207-a91a-d6fd9381efc2 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:28.434185 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7cd8e-b769-4d2a-b1b0-2d96d00030cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:28.434835 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7cd8e-b769-4d2a-b1b0-2d96d00030cd None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:28.435114 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7cd8e-b769-4d2a-b1b0-2d96d00030cd None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:28.435386 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7cd8e-b769-4d2a-b1b0-2d96d00030cd None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:28.436061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7cd8e-b769-4d2a-b1b0-2d96d00030cd None admin] RBAC: Adding query filter params (name=service) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:28.436368 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7cd8e-b769-4d2a-b1b0-2d96d00030cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:28.437739 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7cd8e-b769-4d2a-b1b0-2d96d00030cd None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:28.450741 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 236/481] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Sep 13 12:04:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:28.452907 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a1de6-3cdb-4f86-8808-79158441aa4e None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:28.530575 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:28.570781 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a1de6-3cdb-4f86-8808-79158441aa4e None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:28.576774 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da4ae0-447b-4edd-9692-c34575342bd9 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:28.577207 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da4ae0-447b-4edd-9692-c34575342bd9 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:28.577654 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da4ae0-447b-4edd-9692-c34575342bd9 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:28.580611 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 237/482] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:04:28.588535 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cb914-402e-4084-b71d-0a9b31637054 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:28.588996 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cb914-402e-4084-b71d-0a9b31637054 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:28.589776 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cb914-402e-4084-b71d-0a9b31637054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:28.609368 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-d18cb914-402e-4084-b71d-0a9b31637054 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:28.610267 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac46ed-034b-4278-aa3d-c01a891c2822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:28.611245 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-d18cb914-402e-4084-b71d-0a9b31637054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:28.611483 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac46ed-034b-4278-aa3d-c01a891c2822 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:28.611764 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac46ed-034b-4278-aa3d-c01a891c2822 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:28.612108 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac46ed-034b-4278-aa3d-c01a891c2822 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:28.623873 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac46ed-034b-4278-aa3d-c01a891c2822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:28.625343 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac46ed-034b-4278-aa3d-c01a891c2822 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:28.643153 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-07ac46ed-034b-4278-aa3d-c01a891c2822 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:28.643153 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:28.643153 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:28.643153 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:28.643153 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:28.643153 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:28.643153 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:28.643153 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:28.643153 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:28.643153 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:28.643153 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:28.643153 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:28.643153 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:28.643153 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:28.643153 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:28.643153 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:28.644182 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:28.644182 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:28.644182 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:28.644182 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:28.644182 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:28.644182 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:28.644182 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:28.644182 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:28.644182 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:28.644182 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:28.644182 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:28.644182 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:28.644182 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:28.644182 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:28.644182 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:28.644182 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:28.644182 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:28.645022 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:28.645022 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:28.645022 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:28.645022 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 246/483] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:28.645767 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac46ed-034b-4278-aa3d-c01a891c2822 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:28.694768 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 238/484] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:04:28.696716 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18cb914-402e-4084-b71d-0a9b31637054 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:28.757246 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:28.772296 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac46ed-034b-4278-aa3d-c01a891c2822 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:28.796638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:28.829894 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a25d3e-827f-4d7c-a03b-31e71fc3cbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:28.830345 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18cb914-402e-4084-b71d-0a9b31637054 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:28.831139 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a25d3e-827f-4d7c-a03b-31e71fc3cbcb None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:28.831618 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a25d3e-827f-4d7c-a03b-31e71fc3cbcb None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:28.832101 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a25d3e-827f-4d7c-a03b-31e71fc3cbcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:28.850773 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a25d3e-827f-4d7c-a03b-31e71fc3cbcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:28.862448 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-e9a25d3e-827f-4d7c-a03b-31e71fc3cbcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:04:28.862448 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:28.862448 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:28.862448 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:28.862448 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:28.862448 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:28.862448 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:28.862448 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:28.862448 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:28.862448 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:28.862448 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:28.862448 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:28.862448 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:28.862448 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:28.862448 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:28.862448 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:28.863605 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:28.863605 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:28.863605 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:28.863605 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:28.863605 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:28.863605 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:28.863605 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:28.863605 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:28.863605 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:28.863605 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:28.863605 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:28.863605 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:28.863605 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:28.863605 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:28.863605 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:28.863605 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:28.864589 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:28.864589 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:28.864589 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:28.864589 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:28.864589 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:28.864589 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:28.864589 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:28.864589 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:28.864589 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:28.864589 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:28.864589 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:04:28.864589 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:28.864589 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 247/485] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Sep 13 12:04:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:28.866903 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb37841-1116-4e24-9e38-8869ace5b3e3 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:28.867361 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb37841-1116-4e24-9e38-8869ace5b3e3 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:28.867833 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb37841-1116-4e24-9e38-8869ace5b3e3 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:28.870190 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 248/486] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:28.871525 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb37841-1116-4e24-9e38-8869ace5b3e3 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:28.880337 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d5a0a-4261-416b-b5ec-83a9962f05f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:28.881281 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d5a0a-4261-416b-b5ec-83a9962f05f5 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:28.881731 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d5a0a-4261-416b-b5ec-83a9962f05f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:28.882170 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d5a0a-4261-416b-b5ec-83a9962f05f5 None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:28.883120 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d5a0a-4261-416b-b5ec-83a9962f05f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:28.883606 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d5a0a-4261-416b-b5ec-83a9962f05f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:28.885256 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d5a0a-4261-416b-b5ec-83a9962f05f5 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:28.900747 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 239/487] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:28.902417 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b6030-98dc-4485-8a43-7a17e02d9762 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:28.902892 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b6030-98dc-4485-8a43-7a17e02d9762 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:28.903670 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b6030-98dc-4485-8a43-7a17e02d9762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:28.929235 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-cd0b6030-98dc-4485-8a43-7a17e02d9762 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:28.932680 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-cd0b6030-98dc-4485-8a43-7a17e02d9762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:29.020895 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb37841-1116-4e24-9e38-8869ace5b3e3 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:29.031327 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 240/488] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:29.033381 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b6030-98dc-4485-8a43-7a17e02d9762 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:29.073226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f02da5-579a-46d4-a587-f81c268e04bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:29.074361 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f02da5-579a-46d4-a587-f81c268e04bd None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:29.074874 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f02da5-579a-46d4-a587-f81c268e04bd None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:29.075371 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f02da5-579a-46d4-a587-f81c268e04bd None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:29.076225 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f02da5-579a-46d4-a587-f81c268e04bd None admin] RBAC: Adding query filter params (name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:29.076715 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f02da5-579a-46d4-a587-f81c268e04bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:29.079112 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f02da5-579a-46d4-a587-f81c268e04bd None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:29.092153 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 249/489] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Sep 13 12:04:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:29.099072 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f02da5-579a-46d4-a587-f81c268e04bd None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:29.102787 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:29.167594 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:29.191912 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b6030-98dc-4485-8a43-7a17e02d9762 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:29.235758 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f02da5-579a-46d4-a587-f81c268e04bd None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:29.236991 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27f81c-6300-4e3d-98af-7d647d28b582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:29.237889 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27f81c-6300-4e3d-98af-7d647d28b582 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:29.238952 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27f81c-6300-4e3d-98af-7d647d28b582 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:29.239234 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27f81c-6300-4e3d-98af-7d647d28b582 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:29.247126 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27f81c-6300-4e3d-98af-7d647d28b582 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:29.248649 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27f81c-6300-4e3d-98af-7d647d28b582 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:29.262910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-3f27f81c-6300-4e3d-98af-7d647d28b582 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:04:29.262910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:29.262910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:29.262910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:29.262910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:29.262910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:29.262910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:29.262910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:29.262910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:29.262910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:29.262910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:29.262910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:29.262910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:04:29.262910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:04:29.262910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:04:29.262910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:04:29.263955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:29.263955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:29.263955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:04:29.263955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:29.263955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:04:29.263955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:29.263955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:29.263955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:29.263955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:29.263955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:29.263955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:29.263955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:29.263955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:29.263955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:29.263955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:29.263955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:29.263955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:29.263955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:29.264848 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:29.264848 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:29.264848 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:04:29.264848 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:04:29.264848 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:04:29.264848 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:04:29.264848 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:04:29.264848 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:04:29.264848 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:04:29.264848 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:29.264848 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 241/490] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Sep 13 12:04:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:29.264848 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27f81c-6300-4e3d-98af-7d647d28b582 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:29.278733 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854c6d7-03c6-4624-b1b8-d515ce552da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:29.279367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854c6d7-03c6-4624-b1b8-d515ce552da3 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:29.279640 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854c6d7-03c6-4624-b1b8-d515ce552da3 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:29.279907 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854c6d7-03c6-4624-b1b8-d515ce552da3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:29.292157 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854c6d7-03c6-4624-b1b8-d515ce552da3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:29.293603 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854c6d7-03c6-4624-b1b8-d515ce552da3 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:29.309040 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-a854c6d7-03c6-4624-b1b8-d515ce552da3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:29.309040 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:29.309040 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:29.309040 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:29.309040 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:29.309040 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:29.309040 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:29.309040 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:29.309040 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:29.309040 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:29.309040 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:29.309040 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:29.309040 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:29.309040 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:29.309040 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:29.309040 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:29.310056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:29.310056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:29.310056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:29.310056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:29.310056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:29.310056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:29.310056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:29.310056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:29.310056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:29.310056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:29.310056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:29.310056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:29.310056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:29.310056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:29.310056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:29.310056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:29.310056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:29.310965 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:29.310965 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:29.310965 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:29.310965 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 250/491] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:29.310965 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854c6d7-03c6-4624-b1b8-d515ce552da3 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:29.380255 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:29.384001 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27f81c-6300-4e3d-98af-7d647d28b582 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:29.418911 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:29.421790 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a33b41-68cd-4eda-b8d3-0856b428b405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:29.422424 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a33b41-68cd-4eda-b8d3-0856b428b405 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:29.422752 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a33b41-68cd-4eda-b8d3-0856b428b405 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:29.423106 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a33b41-68cd-4eda-b8d3-0856b428b405 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:29.429808 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854c6d7-03c6-4624-b1b8-d515ce552da3 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:29.434171 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a33b41-68cd-4eda-b8d3-0856b428b405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:29.440491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-02a33b41-68cd-4eda-b8d3-0856b428b405 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:04:29.440491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:29.440491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:29.440491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:29.440491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:29.440491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:29.440491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:29.440491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:29.440491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:29.440491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:29.440491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:29.440491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:29.440491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:29.440491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:29.440491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:29.440491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:29.443792 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:29.443792 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:29.443792 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:29.443792 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:29.443792 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:29.443792 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:29.443792 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:29.443792 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:29.443792 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:29.443792 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:29.443792 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:29.443792 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:29.443792 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:29.443792 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:29.443792 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:29.443792 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:29.445126 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:29.445126 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:29.445126 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:29.445126 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:29.445126 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:29.445126 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:29.445126 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:29.445126 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:29.445126 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:29.445126 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:29.445126 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:04:29.445126 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:29.445126 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 242/492] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Sep 13 12:04:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:29.445126 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a33b41-68cd-4eda-b8d3-0856b428b405 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:29.481523 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1cd4b-84f2-4994-a11b-5aac244300e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:29.482143 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1cd4b-84f2-4994-a11b-5aac244300e6 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:29.482420 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1cd4b-84f2-4994-a11b-5aac244300e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:29.482714 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1cd4b-84f2-4994-a11b-5aac244300e6 None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:29.483460 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1cd4b-84f2-4994-a11b-5aac244300e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:29.483767 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1cd4b-84f2-4994-a11b-5aac244300e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:29.486902 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1cd4b-84f2-4994-a11b-5aac244300e6 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:29.526761 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 251/493] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Sep 13 12:04:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:29.526761 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1cd4b-84f2-4994-a11b-5aac244300e6 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:29.573722 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a33b41-68cd-4eda-b8d3-0856b428b405 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:29.612415 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307f304-f391-4add-9651-9d4fd0017179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:29.613029 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307f304-f391-4add-9651-9d4fd0017179 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:29.613307 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307f304-f391-4add-9651-9d4fd0017179 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:29.613580 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307f304-f391-4add-9651-9d4fd0017179 None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:29.614236 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307f304-f391-4add-9651-9d4fd0017179 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:29.614540 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307f304-f391-4add-9651-9d4fd0017179 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:29.615986 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307f304-f391-4add-9651-9d4fd0017179 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:29.632878 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 243/494] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:29.632878 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307f304-f391-4add-9651-9d4fd0017179 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:29.653884 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:29.659132 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1cd4b-84f2-4994-a11b-5aac244300e6 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:29.694304 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e9502-e2c1-4ecb-9104-501b444d4636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:29.694872 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e9502-e2c1-4ecb-9104-501b444d4636 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:29.695157 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e9502-e2c1-4ecb-9104-501b444d4636 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:29.695431 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e9502-e2c1-4ecb-9104-501b444d4636 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:29.696095 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e9502-e2c1-4ecb-9104-501b444d4636 None admin] RBAC: Adding query filter params (name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:29.696401 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e9502-e2c1-4ecb-9104-501b444d4636 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:29.697855 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e9502-e2c1-4ecb-9104-501b444d4636 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:29.706391 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 252/495] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Sep 13 12:04:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:29.707226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e9502-e2c1-4ecb-9104-501b444d4636 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:29.725108 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:29.741697 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307f304-f391-4add-9651-9d4fd0017179 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:29.776531 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f43d6-e5eb-4e19-b020-5a5d44d7aeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:29.777142 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f43d6-e5eb-4e19-b020-5a5d44d7aeb4 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:29.777421 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f43d6-e5eb-4e19-b020-5a5d44d7aeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:29.777687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f43d6-e5eb-4e19-b020-5a5d44d7aeb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:29.787793 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f43d6-e5eb-4e19-b020-5a5d44d7aeb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:29.792821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-122f43d6-e5eb-4e19-b020-5a5d44d7aeb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:04:29.792821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:29.792821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:29.792821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:29.792821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:29.792821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:29.792821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:29.792821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:29.792821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:29.792821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:29.792821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:29.792821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:29.792821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:29.792821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:29.792821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:29.792821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:29.793687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:29.793687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:29.793687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:29.793687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:29.793687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:29.793687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:29.793687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:29.793687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:29.793687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:29.793687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:29.793687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:29.793687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:29.793687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:29.793687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:29.793687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:29.793687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:29.794471 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:29.794471 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:29.794471 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:29.794471 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:29.794471 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:29.794471 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:29.794471 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:29.794471 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:29.794471 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:29.794471 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:29.794471 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:04:29.794471 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:29.794471 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 244/496] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Sep 13 12:04:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:29.795159 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f43d6-e5eb-4e19-b020-5a5d44d7aeb4 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:29.813358 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e9502-e2c1-4ecb-9104-501b444d4636 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:29.846855 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349d3aa-f5c9-4ebd-bab8-22561990a3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:29.847456 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349d3aa-f5c9-4ebd-bab8-22561990a3e4 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:29.847739 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349d3aa-f5c9-4ebd-bab8-22561990a3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:29.848014 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349d3aa-f5c9-4ebd-bab8-22561990a3e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:29.874387 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:29.897569 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f43d6-e5eb-4e19-b020-5a5d44d7aeb4 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:29.916026 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349d3aa-f5c9-4ebd-bab8-22561990a3e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:29.917775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349d3aa-f5c9-4ebd-bab8-22561990a3e4 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:29.931944 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:29.932471 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f71321-27e4-4f74-b284-28decf97a681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:29.933099 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f71321-27e4-4f74-b284-28decf97a681 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:29.933629 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f71321-27e4-4f74-b284-28decf97a681 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:29.934022 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f71321-27e4-4f74-b284-28decf97a681 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:29.941722 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f71321-27e4-4f74-b284-28decf97a681 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:29.943214 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f71321-27e4-4f74-b284-28decf97a681 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:29.955053 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-e3f71321-27e4-4f74-b284-28decf97a681 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 12:04:29.955053 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:29.955053 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:29.955053 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:29.955053 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:29.955053 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:29.955053 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:29.955053 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:29.955053 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:29.955053 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:29.955053 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:29.955053 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:29.955053 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:04:29.955053 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:04:29.955053 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:04:29.955053 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:04:29.956198 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:29.956198 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:29.956198 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:04:29.956198 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:29.956198 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:04:29.956198 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:29.956198 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:29.956198 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:29.956198 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:29.956198 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:29.956198 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:29.956198 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:29.956198 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:29.956198 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:29.956198 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:29.956198 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:29.956198 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:29.956198 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:29.957075 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:29.957075 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:29.957075 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:04:29.957075 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:04:29.957075 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:04:29.957075 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:04:29.957075 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:04:29.957075 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:04:29.957075 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 12:04:29.957075 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:29.957075 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 245/497] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:29.957075 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f71321-27e4-4f74-b284-28decf97a681 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:30.018804 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 253/498] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:04:30.019904 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349d3aa-f5c9-4ebd-bab8-22561990a3e4 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:30.060538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f71321-27e4-4f74-b284-28decf97a681 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:30.095272 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e4689-2918-4d32-9fc4-492e87259cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:30.096125 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e4689-2918-4d32-9fc4-492e87259cea None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:30.096239 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e4689-2918-4d32-9fc4-492e87259cea None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:30.096421 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e4689-2918-4d32-9fc4-492e87259cea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:30.103406 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:30.107920 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e4689-2918-4d32-9fc4-492e87259cea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:30.109763 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e4689-2918-4d32-9fc4-492e87259cea None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:30.118291 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349d3aa-f5c9-4ebd-bab8-22561990a3e4 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:30.126852 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-643e4689-2918-4d32-9fc4-492e87259cea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:30.126852 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:30.126852 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:30.126852 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:30.126852 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:30.126852 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:30.126852 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:30.126852 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:30.126852 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:30.126852 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:30.126852 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:30.126852 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:30.126852 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:30.126852 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:30.126852 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:30.126852 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:30.127957 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:30.127957 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:30.127957 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:30.127957 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:30.127957 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:30.127957 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:30.127957 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:30.127957 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:30.127957 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:30.127957 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:30.127957 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:30.127957 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:30.127957 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:30.127957 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:30.127957 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:30.127957 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:30.127957 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:30.128798 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:30.128798 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:30.128798 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:30.128798 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 246/499] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:30.128798 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e4689-2918-4d32-9fc4-492e87259cea None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:30.136896 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:30.160244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a538a9-1a5f-478b-b7a8-53d4f7c434d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:30.161171 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a538a9-1a5f-478b-b7a8-53d4f7c434d2 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:30.161635 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a538a9-1a5f-478b-b7a8-53d4f7c434d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:30.161901 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a538a9-1a5f-478b-b7a8-53d4f7c434d2 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:30.162563 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a538a9-1a5f-478b-b7a8-53d4f7c434d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:30.162901 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a538a9-1a5f-478b-b7a8-53d4f7c434d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:30.164270 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a538a9-1a5f-478b-b7a8-53d4f7c434d2 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:30.172362 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 254/500] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Sep 13 12:04:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:30.173731 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a538a9-1a5f-478b-b7a8-53d4f7c434d2 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:30.228828 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e4689-2918-4d32-9fc4-492e87259cea None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:30.262373 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a162a9-b1a0-4a42-b6ec-63d3f7c5c0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:30.263006 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a162a9-b1a0-4a42-b6ec-63d3f7c5c0ef None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:30.263286 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a162a9-b1a0-4a42-b6ec-63d3f7c5c0ef None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:30.263560 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a162a9-b1a0-4a42-b6ec-63d3f7c5c0ef None admin] PATH_INFO: `/v3/users` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:30.264285 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a162a9-b1a0-4a42-b6ec-63d3f7c5c0ef None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:30.264593 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a162a9-b1a0-4a42-b6ec-63d3f7c5c0ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:30.266037 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a162a9-b1a0-4a42-b6ec-63d3f7c5c0ef None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:30.279684 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a538a9-1a5f-478b-b7a8-53d4f7c434d2 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:30.303962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 247/501] 10.222.0.15 () {56 vars in 1137 bytes} [Tue Sep 13 12:04:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:30.304805 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a162a9-b1a0-4a42-b6ec-63d3f7c5c0ef None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:30.316398 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cceee8-50e9-478c-b5fc-ed6b7f1bc41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:30.317025 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cceee8-50e9-478c-b5fc-ed6b7f1bc41f None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:30.317300 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cceee8-50e9-478c-b5fc-ed6b7f1bc41f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:30.317571 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cceee8-50e9-478c-b5fc-ed6b7f1bc41f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:30.329595 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cceee8-50e9-478c-b5fc-ed6b7f1bc41f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:30.331098 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cceee8-50e9-478c-b5fc-ed6b7f1bc41f None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:30.345547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-b6cceee8-50e9-478c-b5fc-ed6b7f1bc41f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:30.345547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:30.345547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:30.345547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:30.345547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:30.345547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:30.345547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:30.345547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:30.345547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:30.345547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:30.345547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:30.345547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:30.345547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:30.345547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:30.345547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:30.345547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:30.347092 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:30.347092 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:30.347092 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:30.347092 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:30.347092 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:30.347092 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:30.347092 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:30.347092 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:30.347092 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:30.347092 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:30.347092 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:30.347092 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:30.347092 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:30.347092 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:30.347092 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:30.347092 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:30.347092 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:30.348286 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:30.348286 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:30.348286 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:30.348286 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 255/502] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:30.348286 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cceee8-50e9-478c-b5fc-ed6b7f1bc41f None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:30.361143 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:30.377887 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:30.413410 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a162a9-b1a0-4a42-b6ec-63d3f7c5c0ef None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:30.446917 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9898dd-ae88-45f1-8966-322c3061cc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:30.447509 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9898dd-ae88-45f1-8966-322c3061cc03 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:30.447783 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9898dd-ae88-45f1-8966-322c3061cc03 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:30.448051 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9898dd-ae88-45f1-8966-322c3061cc03 None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:30.448690 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9898dd-ae88-45f1-8966-322c3061cc03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:30.448988 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9898dd-ae88-45f1-8966-322c3061cc03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:30.449614 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cceee8-50e9-478c-b5fc-ed6b7f1bc41f None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:30.450504 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9898dd-ae88-45f1-8966-322c3061cc03 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:30.462537 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 248/503] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:30.467199 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9898dd-ae88-45f1-8966-322c3061cc03 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:30.484333 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facbe67-ad86-47bf-aed7-df95fcff2220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:30.484894 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facbe67-ad86-47bf-aed7-df95fcff2220 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:30.485171 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facbe67-ad86-47bf-aed7-df95fcff2220 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:30.485479 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7facbe67-ad86-47bf-aed7-df95fcff2220 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:30.497118 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7facbe67-ad86-47bf-aed7-df95fcff2220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:30.498778 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7facbe67-ad86-47bf-aed7-df95fcff2220 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:30.518071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-7facbe67-ad86-47bf-aed7-df95fcff2220 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:30.518071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:30.518071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:30.518071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:30.518071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:30.518071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:30.518071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:30.518071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:30.518071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:30.518071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:30.518071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:30.518071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:30.518071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:30.518071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:30.518071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:30.518071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:30.519267 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:30.519267 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:30.519267 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:30.519267 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:30.519267 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:30.519267 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:30.519267 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:30.519267 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:30.519267 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:30.519267 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:30.519267 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:30.519267 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:30.519267 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:30.519267 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:30.519267 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:30.519267 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:30.519267 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:30.520319 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:30.520319 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:30.520319 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:30.520319 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 256/504] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:30.520319 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facbe67-ad86-47bf-aed7-df95fcff2220 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:30.569517 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9898dd-ae88-45f1-8966-322c3061cc03 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:30.578563 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:30.599637 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:30.606582 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef47b5-76a8-4f88-8f58-a4ffcb86e9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:30.607201 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef47b5-76a8-4f88-8f58-a4ffcb86e9b9 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:30.607476 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef47b5-76a8-4f88-8f58-a4ffcb86e9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:30.607772 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef47b5-76a8-4f88-8f58-a4ffcb86e9b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:30.621083 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7facbe67-ad86-47bf-aed7-df95fcff2220 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:30.654869 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d255bc5-25d0-4025-bc4b-d34e3ac6c446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:30.655548 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d255bc5-25d0-4025-bc4b-d34e3ac6c446 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:30.655746 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d255bc5-25d0-4025-bc4b-d34e3ac6c446 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:30.656021 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d255bc5-25d0-4025-bc4b-d34e3ac6c446 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:30.656663 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d255bc5-25d0-4025-bc4b-d34e3ac6c446 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:30.656965 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d255bc5-25d0-4025-bc4b-d34e3ac6c446 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:30.659016 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d255bc5-25d0-4025-bc4b-d34e3ac6c446 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:30.671475 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 257/505] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:30.671475 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d255bc5-25d0-4025-bc4b-d34e3ac6c446 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:30.678593 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef47b5-76a8-4f88-8f58-a4ffcb86e9b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:30.680085 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef47b5-76a8-4f88-8f58-a4ffcb86e9b9 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:30.773845 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d255bc5-25d0-4025-bc4b-d34e3ac6c446 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:30.779573 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 249/506] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:04:30.780405 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef47b5-76a8-4f88-8f58-a4ffcb86e9b9 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:30.790948 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:30.812043 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef373f-45f2-4278-b9f9-941d9924e0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:30.812674 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef373f-45f2-4278-b9f9-941d9924e0ad None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:30.812951 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef373f-45f2-4278-b9f9-941d9924e0ad None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:30.813223 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef373f-45f2-4278-b9f9-941d9924e0ad None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:30.820810 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef373f-45f2-4278-b9f9-941d9924e0ad None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:30.822249 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef373f-45f2-4278-b9f9-941d9924e0ad None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:30.824006 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:30.836955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-77ef373f-45f2-4278-b9f9-941d9924e0ad None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 12:04:30.836955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:30.836955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:30.836955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:30.836955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:30.836955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:30.836955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:30.836955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:30.836955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:30.836955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:30.836955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:30.836955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:30.836955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:04:30.836955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:04:30.836955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:04:30.836955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:04:30.837950 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:30.837950 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:30.837950 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:04:30.837950 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:30.837950 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:04:30.837950 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:30.837950 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:30.837950 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:30.837950 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:30.837950 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:30.837950 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:30.837950 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:30.837950 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:30.837950 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:30.837950 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:30.837950 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:30.837950 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:30.837950 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:30.838919 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:30.838919 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:30.838919 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:04:30.838919 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:04:30.838919 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:04:30.838919 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:04:30.838919 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:04:30.838919 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:04:30.838919 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 12:04:30.838919 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:30.838919 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 258/507] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Sep 13 12:04:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:30.838919 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef373f-45f2-4278-b9f9-941d9924e0ad None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:30.886110 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef47b5-76a8-4f88-8f58-a4ffcb86e9b9 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:30.921117 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aed640-b651-4189-8e75-920b42b59489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:30.921708 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aed640-b651-4189-8e75-920b42b59489 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:30.921982 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aed640-b651-4189-8e75-920b42b59489 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:30.922264 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aed640-b651-4189-8e75-920b42b59489 None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:30.923000 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aed640-b651-4189-8e75-920b42b59489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:30.923312 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aed640-b651-4189-8e75-920b42b59489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:30.924694 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aed640-b651-4189-8e75-920b42b59489 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:30.935957 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 250/508] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:30.936760 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aed640-b651-4189-8e75-920b42b59489 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:30.943445 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef373f-45f2-4278-b9f9-941d9924e0ad None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:30.976778 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da83ae1-e71e-458e-8b4e-7f09f03633e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:30.977399 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da83ae1-e71e-458e-8b4e-7f09f03633e5 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:30.977679 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da83ae1-e71e-458e-8b4e-7f09f03633e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:30.977954 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da83ae1-e71e-458e-8b4e-7f09f03633e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:30.984692 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da83ae1-e71e-458e-8b4e-7f09f03633e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:30.986301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da83ae1-e71e-458e-8b4e-7f09f03633e5 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:30.998357 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-6da83ae1-e71e-458e-8b4e-7f09f03633e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:30.998357 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:30.998357 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:30.998357 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:30.998357 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:30.998357 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:30.998357 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:30.998357 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:30.998357 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:30.998357 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:30.998357 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:30.998357 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:30.998357 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:04:30.998357 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:04:30.998357 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:04:30.999244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:04:30.999244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:30.999244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:30.999244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:30.999244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:30.999244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:30.999244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:30.999244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:30.999244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:30.999244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:30.999244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:30.999244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:30.999244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:30.999244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:30.999244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:30.999244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:30.999244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:31.000080 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:04:31.000080 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:04:31.000080 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:04:31.000080 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:04:31.000080 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:04:31.000080 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:04:31.000080 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:31.000080 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:31.000080 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 259/509] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:31.000561 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da83ae1-e71e-458e-8b4e-7f09f03633e5 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:31.006149 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:31.041028 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aed640-b651-4189-8e75-920b42b59489 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:31.059961 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:31.074567 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fad82d-1535-4a9a-9fea-42f3d96c2cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:31.075239 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fad82d-1535-4a9a-9fea-42f3d96c2cb0 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:31.075517 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fad82d-1535-4a9a-9fea-42f3d96c2cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:31.075788 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fad82d-1535-4a9a-9fea-42f3d96c2cb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:31.087741 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fad82d-1535-4a9a-9fea-42f3d96c2cb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:31.089186 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fad82d-1535-4a9a-9fea-42f3d96c2cb0 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:31.102356 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da83ae1-e71e-458e-8b4e-7f09f03633e5 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:31.103579 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-b8fad82d-1535-4a9a-9fea-42f3d96c2cb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:31.103579 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:31.103579 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:31.103579 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:31.103579 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:31.103579 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:31.103579 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:31.103579 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:31.103579 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:31.103579 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:31.103579 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:31.103579 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:31.103579 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:31.103579 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:31.103579 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:31.103579 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:31.104460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:31.104460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:31.104460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:31.104460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:31.104460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:31.104460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:31.104460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:31.104460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:31.104460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:31.104460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:31.104460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:31.104460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:31.104460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:31.104460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:31.104460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:31.104460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:31.104460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:31.105332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:31.105332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:31.105332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:31.105332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 251/510] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:31.105332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fad82d-1535-4a9a-9fea-42f3d96c2cb0 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:31.141203 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6e69c-f313-4327-bfdd-9df0f2df9150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:31.142440 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6e69c-f313-4327-bfdd-9df0f2df9150 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:31.142944 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6e69c-f313-4327-bfdd-9df0f2df9150 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:31.143246 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6e69c-f313-4327-bfdd-9df0f2df9150 None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:31.143975 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6e69c-f313-4327-bfdd-9df0f2df9150 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:31.144288 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6e69c-f313-4327-bfdd-9df0f2df9150 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:31.145800 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6e69c-f313-4327-bfdd-9df0f2df9150 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:31.162884 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 260/511] 10.222.0.15 () {56 vars in 1139 bytes} [Tue Sep 13 12:04:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:31.163533 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6e69c-f313-4327-bfdd-9df0f2df9150 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:31.212264 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fad82d-1535-4a9a-9fea-42f3d96c2cb0 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:31.231541 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:31.245897 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9ddbb-6490-428c-8ae0-b2322d4adfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:31.246509 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9ddbb-6490-428c-8ae0-b2322d4adfa0 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:31.246819 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9ddbb-6490-428c-8ae0-b2322d4adfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:31.247095 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9ddbb-6490-428c-8ae0-b2322d4adfa0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:31.255027 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9ddbb-6490-428c-8ae0-b2322d4adfa0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:31.256459 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9ddbb-6490-428c-8ae0-b2322d4adfa0 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:31.263940 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6e69c-f313-4327-bfdd-9df0f2df9150 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:31.268337 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-eea9ddbb-6490-428c-8ae0-b2322d4adfa0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 12:04:31.268337 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:31.268337 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:31.268337 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:31.268337 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:31.268337 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:31.268337 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:31.268337 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:31.268337 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:31.268337 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:31.268337 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:31.268337 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:31.268337 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:04:31.268337 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:04:31.268337 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:04:31.268337 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:04:31.269302 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:31.269302 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:31.269302 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:04:31.269302 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:31.269302 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:04:31.269302 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:31.269302 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:31.269302 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:31.269302 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:31.269302 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:31.269302 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:31.269302 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:31.269302 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:31.269302 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:31.269302 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:31.269302 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:31.269302 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:31.269302 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:31.270232 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:31.270232 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:31.270232 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:04:31.270232 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:04:31.270232 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:04:31.270232 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:04:31.270232 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:04:31.270232 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:04:31.270232 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 12:04:31.270232 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:31.270232 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 252/512] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:31.270850 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9ddbb-6490-428c-8ae0-b2322d4adfa0 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:31.281076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:31.299615 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a6798-f09f-4bbf-af91-ea70a11be889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:31.300153 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a6798-f09f-4bbf-af91-ea70a11be889 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:31.300436 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a6798-f09f-4bbf-af91-ea70a11be889 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:31.300714 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a6798-f09f-4bbf-af91-ea70a11be889 None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:31.301406 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a6798-f09f-4bbf-af91-ea70a11be889 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:31.301716 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a6798-f09f-4bbf-af91-ea70a11be889 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:31.303198 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a6798-f09f-4bbf-af91-ea70a11be889 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:31.321136 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 261/513] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Sep 13 12:04:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:31.321948 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a6798-f09f-4bbf-af91-ea70a11be889 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:31.374397 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9ddbb-6490-428c-8ae0-b2322d4adfa0 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:31.409250 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e2fcd-9e09-4b80-87d4-13e1930b39c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:31.409845 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e2fcd-9e09-4b80-87d4-13e1930b39c0 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:31.410118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e2fcd-9e09-4b80-87d4-13e1930b39c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:31.410385 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e2fcd-9e09-4b80-87d4-13e1930b39c0 None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:31.411054 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e2fcd-9e09-4b80-87d4-13e1930b39c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:31.411356 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e2fcd-9e09-4b80-87d4-13e1930b39c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:31.412704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e2fcd-9e09-4b80-87d4-13e1930b39c0 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:31.422087 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a6798-f09f-4bbf-af91-ea70a11be889 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:31.425113 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 253/514] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:31.425899 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e2fcd-9e09-4b80-87d4-13e1930b39c0 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:31.462318 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e8815-1765-4f08-af3b-d574226880c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:31.462976 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e8815-1765-4f08-af3b-d574226880c0 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:31.463253 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e8815-1765-4f08-af3b-d574226880c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:31.463526 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e8815-1765-4f08-af3b-d574226880c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:31.471346 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:31.509831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:31.532049 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e2fcd-9e09-4b80-87d4-13e1930b39c0 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:31.534333 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e8815-1765-4f08-af3b-d574226880c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:31.535839 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e8815-1765-4f08-af3b-d574226880c0 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:31.566502 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124366e0-c198-4863-9227-1c172d7ceda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:31.567155 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124366e0-c198-4863-9227-1c172d7ceda0 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:31.567433 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124366e0-c198-4863-9227-1c172d7ceda0 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:31.567705 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124366e0-c198-4863-9227-1c172d7ceda0 None admin] PATH_INFO: `/v3/users` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:31.568425 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124366e0-c198-4863-9227-1c172d7ceda0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:31.568729 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124366e0-c198-4863-9227-1c172d7ceda0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:31.570149 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124366e0-c198-4863-9227-1c172d7ceda0 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:31.587344 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 254/515] 10.222.0.15 () {56 vars in 1137 bytes} [Tue Sep 13 12:04:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:31.588149 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124366e0-c198-4863-9227-1c172d7ceda0 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:31.640405 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 262/516] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:04:31.641324 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e8815-1765-4f08-af3b-d574226880c0 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:31.691741 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:31.695612 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124366e0-c198-4863-9227-1c172d7ceda0 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:31.721133 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:31.731655 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459a072-f599-41f9-97f7-349f9d79ff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:31.732343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459a072-f599-41f9-97f7-349f9d79ff28 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:31.732619 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459a072-f599-41f9-97f7-349f9d79ff28 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:31.732888 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459a072-f599-41f9-97f7-349f9d79ff28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:31.733611 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459a072-f599-41f9-97f7-349f9d79ff28 None admin] RBAC: Adding query filter params (role.id=45922c768b6541549cc7b4aa2d49b0ac, scope.project.id=2cd599a81e8043bebfca960673e63bbc, user.id=e740dc7330284b0bbe6a825186f0a55d) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:31.733912 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459a072-f599-41f9-97f7-349f9d79ff28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:31.735382 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459a072-f599-41f9-97f7-349f9d79ff28 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:31.740962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 255/517] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:04:31 2022] GET /identity/v3/role_assignments?user.id=e740dc7330284b0bbe6a825186f0a55d&scope.project.id=2cd599a81e8043bebfca960673e63bbc&role.id=45922c768b6541549cc7b4aa2d49b0ac => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:31.741731 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459a072-f599-41f9-97f7-349f9d79ff28 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:31.759848 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e8815-1765-4f08-af3b-d574226880c0 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:31.801769 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afe7ac-9241-43fb-88bb-c3fcdc31a27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:31.802450 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afe7ac-9241-43fb-88bb-c3fcdc31a27e None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:31.802830 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afe7ac-9241-43fb-88bb-c3fcdc31a27e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:31.803135 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94afe7ac-9241-43fb-88bb-c3fcdc31a27e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:31.810966 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afe7ac-9241-43fb-88bb-c3fcdc31a27e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:31.812459 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94afe7ac-9241-43fb-88bb-c3fcdc31a27e None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:31.826360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-94afe7ac-9241-43fb-88bb-c3fcdc31a27e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:31.826360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:31.826360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:31.826360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:31.826360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:31.826360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:31.826360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:31.826360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:31.826360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:31.826360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:31.826360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:31.826360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:31.826360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:04:31.826360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:04:31.826360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:04:31.827316 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:04:31.827316 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:31.827316 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:31.827316 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:31.827316 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:31.827316 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:31.827316 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:31.827316 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:31.827316 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:31.827316 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:31.827316 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:31.827316 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:31.827316 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:31.827316 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:31.827316 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:31.827316 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:31.827316 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:31.828148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:04:31.828148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:04:31.828148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:04:31.828148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:04:31.828148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:04:31.828148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:04:31.828148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:31.828148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:31.828148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 263/518] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:31.830883 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afe7ac-9241-43fb-88bb-c3fcdc31a27e None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:31.866865 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459a072-f599-41f9-97f7-349f9d79ff28 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:31.904545 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a513853-dafc-4eca-8a18-39adab84ae58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:31.905166 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a513853-dafc-4eca-8a18-39adab84ae58 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:31.905450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a513853-dafc-4eca-8a18-39adab84ae58 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:31.905726 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a513853-dafc-4eca-8a18-39adab84ae58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:31.940717 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:31.947120 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94afe7ac-9241-43fb-88bb-c3fcdc31a27e None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:31.997143 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a513853-dafc-4eca-8a18-39adab84ae58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:31.998034 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16f74e-0a05-4a2c-a677-b90a2ec5a166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:31.998629 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a513853-dafc-4eca-8a18-39adab84ae58 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:31.998777 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16f74e-0a05-4a2c-a677-b90a2ec5a166 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:31.999024 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16f74e-0a05-4a2c-a677-b90a2ec5a166 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:31.999273 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16f74e-0a05-4a2c-a677-b90a2ec5a166 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:32.003528 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:32.013423 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16f74e-0a05-4a2c-a677-b90a2ec5a166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:32.014912 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16f74e-0a05-4a2c-a677-b90a2ec5a166 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:32.035415 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-ab16f74e-0a05-4a2c-a677-b90a2ec5a166 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:32.035415 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:32.035415 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:32.035415 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:32.035415 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:32.035415 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:32.035415 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:32.035415 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:32.035415 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:32.035415 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:32.035415 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:32.035415 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:32.035415 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:32.035415 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:32.035415 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:32.035415 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:32.036386 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:32.036386 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:32.036386 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:32.036386 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:32.036386 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:32.036386 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:32.036386 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:32.036386 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:32.036386 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:32.036386 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:32.036386 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:32.036386 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:32.036386 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:32.036386 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:32.036386 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:32.036386 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:32.036386 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:32.037413 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:32.037413 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:32.037413 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:32.039178 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 264/519] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:32.040065 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16f74e-0a05-4a2c-a677-b90a2ec5a166 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:32.140818 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 256/520] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:04:32.142063 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a513853-dafc-4eca-8a18-39adab84ae58 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:32.197070 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16f74e-0a05-4a2c-a677-b90a2ec5a166 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:32.210867 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:32.234706 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb13c40-b6e2-4d7d-a4f0-9f86ba143b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:32.235306 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb13c40-b6e2-4d7d-a4f0-9f86ba143b1c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:32.236231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb13c40-b6e2-4d7d-a4f0-9f86ba143b1c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:32.236464 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb13c40-b6e2-4d7d-a4f0-9f86ba143b1c None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:32.237144 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb13c40-b6e2-4d7d-a4f0-9f86ba143b1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:32.237696 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb13c40-b6e2-4d7d-a4f0-9f86ba143b1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:32.238932 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb13c40-b6e2-4d7d-a4f0-9f86ba143b1c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:32.252705 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 265/521] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Sep 13 12:04:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:32.253515 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb13c40-b6e2-4d7d-a4f0-9f86ba143b1c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:32.276038 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a513853-dafc-4eca-8a18-39adab84ae58 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:32.312370 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:32.320946 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639f5f8-207b-48f5-b793-7bc0784a8506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:32.321560 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639f5f8-207b-48f5-b793-7bc0784a8506 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:32.321839 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639f5f8-207b-48f5-b793-7bc0784a8506 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:32.322207 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639f5f8-207b-48f5-b793-7bc0784a8506 None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:32.322925 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639f5f8-207b-48f5-b793-7bc0784a8506 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:32.323233 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639f5f8-207b-48f5-b793-7bc0784a8506 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:32.324621 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639f5f8-207b-48f5-b793-7bc0784a8506 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:32.337944 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 257/522] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:32.338830 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639f5f8-207b-48f5-b793-7bc0784a8506 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:32.382133 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb13c40-b6e2-4d7d-a4f0-9f86ba143b1c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:32.418571 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06b309-27d8-41e1-8737-50df1d0ac3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:32.419138 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06b309-27d8-41e1-8737-50df1d0ac3cc None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:32.419413 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06b309-27d8-41e1-8737-50df1d0ac3cc None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:32.419679 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06b309-27d8-41e1-8737-50df1d0ac3cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:32.431518 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06b309-27d8-41e1-8737-50df1d0ac3cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:32.432970 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06b309-27d8-41e1-8737-50df1d0ac3cc None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:32.452345 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-9f06b309-27d8-41e1-8737-50df1d0ac3cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:32.452345 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:32.452345 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:32.452345 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:32.452345 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:32.452345 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:32.452345 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:32.452345 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:32.452345 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:32.452345 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:32.452345 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:32.452345 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:32.452345 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:32.452345 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:32.452345 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:32.452345 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:32.453365 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:32.453365 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:32.453365 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:32.453365 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:32.453365 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:32.453365 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:32.453365 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:32.453365 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:32.453365 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:32.453365 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:32.453365 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:32.453365 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:32.453365 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:32.453365 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:32.453365 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:32.453365 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:32.453365 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:32.454276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:32.454276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:32.454276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:32.454276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 266/523] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:32.455294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06b309-27d8-41e1-8737-50df1d0ac3cc None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:32.488793 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639f5f8-207b-48f5-b793-7bc0784a8506 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:32.515699 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:32.530216 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c35244-3f8b-4e47-9051-d3ad09fa3deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:32.530857 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c35244-3f8b-4e47-9051-d3ad09fa3deb None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:32.531138 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c35244-3f8b-4e47-9051-d3ad09fa3deb None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:32.531411 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c35244-3f8b-4e47-9051-d3ad09fa3deb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:32.532837 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c35244-3f8b-4e47-9051-d3ad09fa3deb None admin] RBAC: Adding query filter params (role.id=45922c768b6541549cc7b4aa2d49b0ac, scope.project.id=2cd599a81e8043bebfca960673e63bbc, user.id=4e2b26fb30024905986a99000564b475) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:32.533284 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c35244-3f8b-4e47-9051-d3ad09fa3deb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:32.534784 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c35244-3f8b-4e47-9051-d3ad09fa3deb None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:32.550653 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 258/524] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:04:32 2022] GET /identity/v3/role_assignments?user.id=4e2b26fb30024905986a99000564b475&scope.project.id=2cd599a81e8043bebfca960673e63bbc&role.id=45922c768b6541549cc7b4aa2d49b0ac => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:32.550653 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c35244-3f8b-4e47-9051-d3ad09fa3deb None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:32.584546 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:32.588193 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06b309-27d8-41e1-8737-50df1d0ac3cc None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:32.639995 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0cc85-790b-484e-b06b-6cf355afc7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:32.640937 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0cc85-790b-484e-b06b-6cf355afc7dd None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:32.641219 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0cc85-790b-484e-b06b-6cf355afc7dd None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:32.641489 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0cc85-790b-484e-b06b-6cf355afc7dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:32.653183 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0cc85-790b-484e-b06b-6cf355afc7dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:32.655111 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0cc85-790b-484e-b06b-6cf355afc7dd None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:32.675585 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-0da0cc85-790b-484e-b06b-6cf355afc7dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:32.675585 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:32.675585 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:32.675585 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:32.675585 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:32.675585 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:32.675585 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:32.675585 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:32.675585 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:32.675585 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:32.675585 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:32.675585 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:32.675585 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:04:32.675585 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:04:32.675585 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:04:32.676863 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:04:32.676863 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:32.676863 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:32.676863 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:32.676863 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:32.676863 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:32.676863 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:32.676863 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:32.676863 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:32.676863 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:32.676863 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:32.676863 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:32.676863 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:32.676863 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:32.676863 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:32.676863 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:32.676863 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:32.677971 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:04:32.677971 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:04:32.677971 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:04:32.677971 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:04:32.677971 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:04:32.677971 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:04:32.677971 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:32.677971 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:32.677971 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 267/525] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:32.687565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0cc85-790b-484e-b06b-6cf355afc7dd None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:32.697153 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c35244-3f8b-4e47-9051-d3ad09fa3deb None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:32.738426 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca71aa0-4c83-46e0-9aff-ca25ad7d6b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:32.739255 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca71aa0-4c83-46e0-9aff-ca25ad7d6b95 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:32.739651 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca71aa0-4c83-46e0-9aff-ca25ad7d6b95 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:32.740177 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca71aa0-4c83-46e0-9aff-ca25ad7d6b95 None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:32.740987 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca71aa0-4c83-46e0-9aff-ca25ad7d6b95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:32.741415 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca71aa0-4c83-46e0-9aff-ca25ad7d6b95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:32.742942 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca71aa0-4c83-46e0-9aff-ca25ad7d6b95 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:32.757643 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 259/526] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:32.764028 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca71aa0-4c83-46e0-9aff-ca25ad7d6b95 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:32.834025 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0cc85-790b-484e-b06b-6cf355afc7dd None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:32.836038 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:32.881774 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf92a1-31c1-4596-bff8-6dca1a85e504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:32.882384 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf92a1-31c1-4596-bff8-6dca1a85e504 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:32.882684 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf92a1-31c1-4596-bff8-6dca1a85e504 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:32.882963 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf92a1-31c1-4596-bff8-6dca1a85e504 None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:32.883729 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf92a1-31c1-4596-bff8-6dca1a85e504 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:32.884148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf92a1-31c1-4596-bff8-6dca1a85e504 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:32.885585 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf92a1-31c1-4596-bff8-6dca1a85e504 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:32.904844 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 268/527] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Sep 13 12:04:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:32.906301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf92a1-31c1-4596-bff8-6dca1a85e504 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:32.913350 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca71aa0-4c83-46e0-9aff-ca25ad7d6b95 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:32.933421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:32.960240 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfcc8b-7890-4664-9a86-b249e0aa378c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:32.960875 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfcc8b-7890-4664-9a86-b249e0aa378c None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:32.961151 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfcc8b-7890-4664-9a86-b249e0aa378c None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:32.961423 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfcc8b-7890-4664-9a86-b249e0aa378c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:32.968852 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfcc8b-7890-4664-9a86-b249e0aa378c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:32.971103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfcc8b-7890-4664-9a86-b249e0aa378c None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:32.983786 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-76cfcc8b-7890-4664-9a86-b249e0aa378c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:32.983786 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:32.983786 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:32.983786 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:32.983786 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:32.983786 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:32.983786 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:32.983786 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:32.983786 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:32.983786 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:32.983786 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:32.983786 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:32.983786 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:04:32.983786 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:04:32.983786 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:04:32.984683 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:04:32.984683 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:32.984683 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:32.984683 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:32.984683 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:32.984683 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:32.984683 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:32.984683 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:32.984683 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:32.984683 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:32.984683 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:32.984683 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:32.984683 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:32.984683 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:32.984683 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:32.984683 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:32.984683 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:32.985583 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:04:32.985583 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:04:32.985583 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:04:32.985583 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:04:32.985583 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:04:32.985583 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:04:32.985583 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:32.985583 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:32.989873 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 260/528] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:32.991268 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfcc8b-7890-4664-9a86-b249e0aa378c None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:33.046421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf92a1-31c1-4596-bff8-6dca1a85e504 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:33.096680 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6de643-eb15-4e6e-af9c-1cdd44961ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:33.097320 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6de643-eb15-4e6e-af9c-1cdd44961ca4 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:33.097601 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6de643-eb15-4e6e-af9c-1cdd44961ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:33.097873 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6de643-eb15-4e6e-af9c-1cdd44961ca4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:33.098707 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6de643-eb15-4e6e-af9c-1cdd44961ca4 None admin] RBAC: Adding query filter params (role.id=45922c768b6541549cc7b4aa2d49b0ac, scope.project.id=2cd599a81e8043bebfca960673e63bbc, user.id=2e24fc5713164917ba1368ff461e9629) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:33.098958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6de643-eb15-4e6e-af9c-1cdd44961ca4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:33.100401 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6de643-eb15-4e6e-af9c-1cdd44961ca4 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:33.109940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfcc8b-7890-4664-9a86-b249e0aa378c None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:33.114789 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 269/529] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:04:32 2022] GET /identity/v3/role_assignments?user.id=2e24fc5713164917ba1368ff461e9629&scope.project.id=2cd599a81e8043bebfca960673e63bbc&role.id=45922c768b6541549cc7b4aa2d49b0ac => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:33.119993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:33.156338 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08487e1a-fd37-4b6c-b974-9c9e8436f1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:33.157983 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08487e1a-fd37-4b6c-b974-9c9e8436f1ba None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:33.158482 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08487e1a-fd37-4b6c-b974-9c9e8436f1ba None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:33.158998 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08487e1a-fd37-4b6c-b974-9c9e8436f1ba None admin] PATH_INFO: `/v3/projects` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:33.160069 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08487e1a-fd37-4b6c-b974-9c9e8436f1ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:33.160641 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08487e1a-fd37-4b6c-b974-9c9e8436f1ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:33.162422 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08487e1a-fd37-4b6c-b974-9c9e8436f1ba None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:33.184984 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 261/530] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Sep 13 12:04:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:33.191215 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6de643-eb15-4e6e-af9c-1cdd44961ca4 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:33.292785 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:33.312478 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6de643-eb15-4e6e-af9c-1cdd44961ca4 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:33.350481 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ebc14-b431-4e09-874d-bdf35dfee512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:33.351132 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ebc14-b431-4e09-874d-bdf35dfee512 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:33.351411 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ebc14-b431-4e09-874d-bdf35dfee512 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:33.351866 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ebc14-b431-4e09-874d-bdf35dfee512 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:33.352627 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ebc14-b431-4e09-874d-bdf35dfee512 None admin] RBAC: Adding query filter params (role.id=45922c768b6541549cc7b4aa2d49b0ac, scope.project.id=2cd599a81e8043bebfca960673e63bbc, user.id=06cb1e39f474441495bc09988786a84a) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:33.352985 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ebc14-b431-4e09-874d-bdf35dfee512 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:33.354443 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ebc14-b431-4e09-874d-bdf35dfee512 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:33.366862 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 270/531] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:04:33 2022] GET /identity/v3/role_assignments?user.id=06cb1e39f474441495bc09988786a84a&scope.project.id=2cd599a81e8043bebfca960673e63bbc&role.id=45922c768b6541549cc7b4aa2d49b0ac => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:34.230474 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a3e19-6e31-4d6a-9bd4-19279ec84592 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:34.231205 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a3e19-6e31-4d6a-9bd4-19279ec84592 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:34.231205 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a3e19-6e31-4d6a-9bd4-19279ec84592 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:34.232642 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 262/532] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:34.238500 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea859a2-8b8b-43e9-bab6-31afedad4919 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:34.238922 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea859a2-8b8b-43e9-bab6-31afedad4919 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:34.239112 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea859a2-8b8b-43e9-bab6-31afedad4919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:34.257706 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-1ea859a2-8b8b-43e9-bab6-31afedad4919 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:34.258930 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-1ea859a2-8b8b-43e9-bab6-31afedad4919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:34.342149 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 271/533] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:34.686126 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a3e19-6e31-4d6a-9bd4-19279ec84592 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:34.855482 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a3e19-6e31-4d6a-9bd4-19279ec84592 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:34.910593 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b79fd-3a05-4a5c-acdd-36d3166eca5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:34.912018 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b79fd-3a05-4a5c-acdd-36d3166eca5b None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:34.912727 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b79fd-3a05-4a5c-acdd-36d3166eca5b None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:34.913419 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b79fd-3a05-4a5c-acdd-36d3166eca5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:34.931757 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b79fd-3a05-4a5c-acdd-36d3166eca5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:34.941225 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-797b79fd-3a05-4a5c-acdd-36d3166eca5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:04:34.941225 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:34.941225 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:34.941225 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:34.941225 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:34.941225 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:34.941225 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:34.941225 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:34.941225 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:34.941225 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:34.941225 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:34.941225 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:34.941225 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:34.941225 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:34.941225 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:34.941225 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:34.942719 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:34.942719 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:34.942719 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:34.942719 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:34.942719 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:34.942719 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:34.942719 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:34.942719 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:34.942719 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:34.942719 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:34.942719 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:34.942719 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:34.942719 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:34.942719 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:34.942719 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:34.942719 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:34.944251 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:34.944251 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:34.944251 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:34.944251 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:34.944251 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:34.944251 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:34.944251 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:34.944251 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:34.944251 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:34.944251 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:34.944251 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:04:34.944251 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:34.947739 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 263/534] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Sep 13 12:04:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:34.955912 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea859a2-8b8b-43e9-bab6-31afedad4919 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:35.059214 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:35.083285 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea859a2-8b8b-43e9-bab6-31afedad4919 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:35.097084 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5b17f-2e75-4fed-8ad1-3b55ecddd05d None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:35.097687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5b17f-2e75-4fed-8ad1-3b55ecddd05d None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:35.098322 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5b17f-2e75-4fed-8ad1-3b55ecddd05d None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:35.100895 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 264/535] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:04:35.107678 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb104d-c73f-4dd5-9acb-329da8423b14 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:35.107946 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb104d-c73f-4dd5-9acb-329da8423b14 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:35.108223 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb104d-c73f-4dd5-9acb-329da8423b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:35.126046 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff07996-91b7-4d23-b25e-eca19933c6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:35.127555 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff07996-91b7-4d23-b25e-eca19933c6b2 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:35.128053 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff07996-91b7-4d23-b25e-eca19933c6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:35.128525 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff07996-91b7-4d23-b25e-eca19933c6b2 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:35.128846 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-89bb104d-c73f-4dd5-9acb-329da8423b14 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:35.129604 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff07996-91b7-4d23-b25e-eca19933c6b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:35.130045 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-89bb104d-c73f-4dd5-9acb-329da8423b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:35.130333 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff07996-91b7-4d23-b25e-eca19933c6b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:35.132261 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff07996-91b7-4d23-b25e-eca19933c6b2 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:35.144416 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 272/536] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Sep 13 12:04:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:35.152169 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff07996-91b7-4d23-b25e-eca19933c6b2 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:35.160568 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:35.223015 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 265/537] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:04:35.272593 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff07996-91b7-4d23-b25e-eca19933c6b2 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:35.310129 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef0643-2873-4dd5-aa30-e3626218e0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:35.310807 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef0643-2873-4dd5-aa30-e3626218e0e9 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:35.311088 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef0643-2873-4dd5-aa30-e3626218e0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:35.311364 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef0643-2873-4dd5-aa30-e3626218e0e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:35.321712 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:35.324345 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef0643-2873-4dd5-aa30-e3626218e0e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:35.325976 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef0643-2873-4dd5-aa30-e3626218e0e9 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:35.341945 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-20ef0643-2873-4dd5-aa30-e3626218e0e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:35.341945 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:35.341945 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:35.341945 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:35.341945 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:35.341945 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:35.341945 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:35.341945 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:35.341945 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:35.341945 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:35.341945 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:35.341945 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:35.341945 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:35.341945 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:35.341945 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:35.341945 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:35.342966 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:35.342966 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:35.342966 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:35.342966 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:35.342966 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:35.342966 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:35.342966 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:35.342966 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:35.342966 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:35.342966 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:35.342966 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:35.342966 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:35.342966 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:35.342966 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:35.342966 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:35.342966 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:35.342966 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:35.343818 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:35.343818 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:35.343818 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:35.343818 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 273/538] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:04:35.348819 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb104d-c73f-4dd5-9acb-329da8423b14 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:35.472105 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb104d-c73f-4dd5-9acb-329da8423b14 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:35.515005 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6e428-1c02-4d7f-ab6c-465ca53cf6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:35.516007 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6e428-1c02-4d7f-ab6c-465ca53cf6ac None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:35.516488 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6e428-1c02-4d7f-ab6c-465ca53cf6ac None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:35.516994 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6e428-1c02-4d7f-ab6c-465ca53cf6ac None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:35.517871 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6e428-1c02-4d7f-ab6c-465ca53cf6ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:35.518412 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6e428-1c02-4d7f-ab6c-465ca53cf6ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:35.520193 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6e428-1c02-4d7f-ab6c-465ca53cf6ac None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:35.534512 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 266/539] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:35.543827 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef0643-2873-4dd5-aa30-e3626218e0e9 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:35.581970 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6e428-1c02-4d7f-ab6c-465ca53cf6ac None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:35.605363 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:35.673592 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef0643-2873-4dd5-aa30-e3626218e0e9 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:35.711043 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f1d8f-9a7d-4973-80e9-5501c6d19bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:35.711682 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f1d8f-9a7d-4973-80e9-5501c6d19bee None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:35.712063 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f1d8f-9a7d-4973-80e9-5501c6d19bee None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:35.712339 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f1d8f-9a7d-4973-80e9-5501c6d19bee None admin] PATH_INFO: `/v3/users/nova` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:35.721880 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f1d8f-9a7d-4973-80e9-5501c6d19bee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:35.723432 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f1d8f-9a7d-4973-80e9-5501c6d19bee None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:35.724566 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6e428-1c02-4d7f-ab6c-465ca53cf6ac None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:35.736395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-2f6f1d8f-9a7d-4973-80e9-5501c6d19bee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:04:35.736395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:35.736395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:35.736395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:35.736395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:35.736395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:35.736395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:35.736395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:35.736395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:35.736395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:35.736395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:35.736395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:35.736395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:04:35.736395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:04:35.736395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:04:35.736395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:04:35.737359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:35.737359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:35.737359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:04:35.737359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:35.737359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:04:35.737359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:35.737359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:35.737359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:35.737359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:35.737359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:35.737359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:35.737359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:35.737359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:35.737359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:35.737359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:35.737359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:35.737359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:35.737359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:35.738330 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:35.738330 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:35.738330 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:04:35.738330 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:04:35.738330 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:04:35.738330 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:04:35.738330 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:04:35.738330 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:04:35.738330 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:04:35.738330 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:35.738330 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 274/540] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Sep 13 12:04:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:35.743338 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f1d8f-9a7d-4973-80e9-5501c6d19bee None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:35.769211 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d215b8f-22a0-4518-9a2b-d5d8705461c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:35.769761 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d215b8f-22a0-4518-9a2b-d5d8705461c2 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:35.770103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d215b8f-22a0-4518-9a2b-d5d8705461c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:35.770410 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d215b8f-22a0-4518-9a2b-d5d8705461c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:35.781853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d215b8f-22a0-4518-9a2b-d5d8705461c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:35.788103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-9d215b8f-22a0-4518-9a2b-d5d8705461c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:04:35.788103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:35.788103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:35.788103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:35.788103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:35.788103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:35.788103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:35.788103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:35.788103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:35.788103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:35.788103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:35.788103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:35.788103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:35.788103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:35.788103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:35.788103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:35.789000 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:35.789000 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:35.789000 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:35.789000 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:35.789000 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:35.789000 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:35.789000 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:35.789000 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:35.789000 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:35.789000 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:35.789000 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:35.789000 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:35.789000 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:35.789000 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:35.789000 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:35.789000 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:35.789802 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:35.789802 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:35.789802 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:35.789802 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:35.789802 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:35.789802 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:35.789802 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:35.789802 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:35.789802 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:35.789802 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:35.789802 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:04:35.789802 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:35.789802 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 267/541] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Sep 13 12:04:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:35.800398 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d215b8f-22a0-4518-9a2b-d5d8705461c2 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:35.811404 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:35.882383 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f1d8f-9a7d-4973-80e9-5501c6d19bee None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:35.911899 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:35.928264 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b04e9a-0574-4035-892e-61aa6ab0d304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:35.928879 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b04e9a-0574-4035-892e-61aa6ab0d304 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:35.929157 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b04e9a-0574-4035-892e-61aa6ab0d304 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:35.929430 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b04e9a-0574-4035-892e-61aa6ab0d304 None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:35.930160 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b04e9a-0574-4035-892e-61aa6ab0d304 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:35.930468 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b04e9a-0574-4035-892e-61aa6ab0d304 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:35.931940 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b04e9a-0574-4035-892e-61aa6ab0d304 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:35.936236 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d215b8f-22a0-4518-9a2b-d5d8705461c2 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:35.950665 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 275/542] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Sep 13 12:04:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:35.951185 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82de56-f659-4901-a7ac-05b97fa2ae60 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:35.951355 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82de56-f659-4901-a7ac-05b97fa2ae60 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:35.951633 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82de56-f659-4901-a7ac-05b97fa2ae60 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:35.953109 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 276/543] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:35.955711 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82de56-f659-4901-a7ac-05b97fa2ae60 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:35.977194 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa9865-25ff-4c9f-be27-efb83b91d3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:35.978128 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa9865-25ff-4c9f-be27-efb83b91d3ab None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:35.978644 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa9865-25ff-4c9f-be27-efb83b91d3ab None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:35.979055 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa9865-25ff-4c9f-be27-efb83b91d3ab None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:35.980020 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa9865-25ff-4c9f-be27-efb83b91d3ab None admin] RBAC: Adding query filter params (name=service) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:35.980483 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa9865-25ff-4c9f-be27-efb83b91d3ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:35.982357 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa9865-25ff-4c9f-be27-efb83b91d3ab None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:35.992345 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 268/544] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Sep 13 12:04:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:35.993774 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa05f03-a850-4f35-ac62-b504ce415395 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:35.994199 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa05f03-a850-4f35-ac62-b504ce415395 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:35.994632 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa05f03-a850-4f35-ac62-b504ce415395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:36.013455 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-daa05f03-a850-4f35-ac62-b504ce415395 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:36.014711 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-daa05f03-a850-4f35-ac62-b504ce415395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:36.068867 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82de56-f659-4901-a7ac-05b97fa2ae60 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:36.080907 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:36.083891 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 269/545] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:36.084799 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa05f03-a850-4f35-ac62-b504ce415395 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:36.114657 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1d934-339e-4a0d-bcea-d6332bfc2fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:36.115271 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1d934-339e-4a0d-bcea-d6332bfc2fc8 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:36.115546 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1d934-339e-4a0d-bcea-d6332bfc2fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:36.116037 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1d934-339e-4a0d-bcea-d6332bfc2fc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:36.128118 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1d934-339e-4a0d-bcea-d6332bfc2fc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:36.130029 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1d934-339e-4a0d-bcea-d6332bfc2fc8 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:36.147621 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-bcd1d934-339e-4a0d-bcea-d6332bfc2fc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:36.147621 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:36.147621 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:36.147621 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:36.147621 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:36.147621 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:36.147621 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:36.147621 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:36.147621 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:36.147621 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:36.147621 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:36.147621 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:36.147621 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:36.147621 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:36.147621 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:36.147621 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:36.149362 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:36.149362 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:36.149362 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:36.149362 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:36.149362 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:36.149362 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:36.149362 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:36.149362 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:36.149362 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:36.149362 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:36.149362 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:36.149362 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:36.149362 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:36.149362 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:36.149362 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:36.149362 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:36.149362 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:36.150686 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:36.150686 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:36.150686 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:36.153558 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 277/546] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:36.154793 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c912c7-46b3-4795-8bd3-c0b340c0873c None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:36.155075 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c912c7-46b3-4795-8bd3-c0b340c0873c None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:36.155467 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c912c7-46b3-4795-8bd3-c0b340c0873c None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:36.156952 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 278/547] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:36.158487 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c912c7-46b3-4795-8bd3-c0b340c0873c None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:36.174218 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:36.210840 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa05f03-a850-4f35-ac62-b504ce415395 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:36.253896 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bf8f3-96b6-449c-b500-e702bf971c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:36.255051 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bf8f3-96b6-449c-b500-e702bf971c64 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:36.255542 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bf8f3-96b6-449c-b500-e702bf971c64 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:36.256380 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bf8f3-96b6-449c-b500-e702bf971c64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:36.270252 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bf8f3-96b6-449c-b500-e702bf971c64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:36.271845 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bf8f3-96b6-449c-b500-e702bf971c64 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:36.272939 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c912c7-46b3-4795-8bd3-c0b340c0873c None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:36.287010 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-680bf8f3-96b6-449c-b500-e702bf971c64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:36.287010 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:36.287010 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:36.287010 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:36.287010 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:36.287010 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:36.287010 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:36.287010 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:36.287010 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:36.287010 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:36.287010 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:36.287010 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:36.287010 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:36.287010 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:36.287010 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:36.287010 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:36.288118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:36.288118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:36.288118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:36.288118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:36.288118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:36.288118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:36.288118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:36.288118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:36.288118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:36.288118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:36.288118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:36.288118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:36.288118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:36.288118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:36.288118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:36.288118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:36.288118 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:36.288955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:36.288955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:36.288955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:36.288955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 270/548] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:36.289332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be698e59-0446-4c1a-93bd-20550aadc009 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:36.289621 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be698e59-0446-4c1a-93bd-20550aadc009 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:36.289902 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be698e59-0446-4c1a-93bd-20550aadc009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:36.313947 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-be698e59-0446-4c1a-93bd-20550aadc009 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:36.316167 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-be698e59-0446-4c1a-93bd-20550aadc009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:36.316692 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910003d-cea1-47a8-afe4-94ae45513d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:36.317320 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910003d-cea1-47a8-afe4-94ae45513d63 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:36.317597 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910003d-cea1-47a8-afe4-94ae45513d63 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:36.317864 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910003d-cea1-47a8-afe4-94ae45513d63 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:36.319168 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910003d-cea1-47a8-afe4-94ae45513d63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:36.319595 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910003d-cea1-47a8-afe4-94ae45513d63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:36.321871 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910003d-cea1-47a8-afe4-94ae45513d63 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:36.336761 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 279/549] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:36.337586 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910003d-cea1-47a8-afe4-94ae45513d63 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:36.365835 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:36.395329 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 271/550] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:36.396267 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be698e59-0446-4c1a-93bd-20550aadc009 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:36.458461 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:36.463947 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910003d-cea1-47a8-afe4-94ae45513d63 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:36.503384 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545e852-eb59-42ed-924f-03b2f1cd4d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:36.503985 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545e852-eb59-42ed-924f-03b2f1cd4d1d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:36.504264 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545e852-eb59-42ed-924f-03b2f1cd4d1d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:36.504766 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545e852-eb59-42ed-924f-03b2f1cd4d1d None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:36.505160 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545e852-eb59-42ed-924f-03b2f1cd4d1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:36.505455 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545e852-eb59-42ed-924f-03b2f1cd4d1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:36.506855 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c545e852-eb59-42ed-924f-03b2f1cd4d1d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:36.510825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be698e59-0446-4c1a-93bd-20550aadc009 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:36.519808 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 280/551] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:36.524383 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545e852-eb59-42ed-924f-03b2f1cd4d1d None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:36.551213 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948edb5e-9b1d-4752-934c-f943b88cdb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:36.551849 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948edb5e-9b1d-4752-934c-f943b88cdb82 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:36.552125 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948edb5e-9b1d-4752-934c-f943b88cdb82 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:36.552396 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948edb5e-9b1d-4752-934c-f943b88cdb82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:36.559518 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948edb5e-9b1d-4752-934c-f943b88cdb82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:36.560947 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948edb5e-9b1d-4752-934c-f943b88cdb82 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:36.574787 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-948edb5e-9b1d-4752-934c-f943b88cdb82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:36.574787 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:36.574787 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:36.574787 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:36.574787 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:36.574787 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:36.574787 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:36.574787 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:36.574787 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:36.574787 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:36.574787 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:36.574787 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:36.574787 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:04:36.574787 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:04:36.574787 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:04:36.575641 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:04:36.575641 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:36.575641 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:36.575641 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:36.575641 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:36.575641 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:36.575641 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:36.575641 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:36.575641 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:36.575641 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:36.575641 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:36.575641 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:36.575641 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:36.575641 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:36.575641 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:36.575641 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:36.575641 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:36.577751 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:04:36.577751 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:04:36.577751 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:04:36.577751 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:04:36.577751 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:04:36.577751 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:04:36.577751 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:36.577751 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:36.577751 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 272/552] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:36.577751 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948edb5e-9b1d-4752-934c-f943b88cdb82 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:36.622638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:36.644101 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545e852-eb59-42ed-924f-03b2f1cd4d1d None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:36.686560 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b045436-7daf-412c-bc57-946baba844ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:36.687202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b045436-7daf-412c-bc57-946baba844ef None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:36.687473 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b045436-7daf-412c-bc57-946baba844ef None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:36.687742 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b045436-7daf-412c-bc57-946baba844ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:36.695455 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948edb5e-9b1d-4752-934c-f943b88cdb82 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:36.700187 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b045436-7daf-412c-bc57-946baba844ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:36.707173 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:36.707381 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-0b045436-7daf-412c-bc57-946baba844ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:04:36.707381 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:36.707381 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:36.707381 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:36.707381 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:36.707381 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:36.707381 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:36.707381 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:36.707381 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:36.707381 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:36.707381 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:36.707381 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:36.707381 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:36.707381 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:36.707381 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:36.707381 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:36.708257 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:36.708257 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:36.708257 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:36.708257 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:36.708257 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:36.708257 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:36.708257 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:36.708257 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:36.708257 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:36.708257 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:36.708257 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:36.708257 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:36.708257 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:36.708257 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:36.708257 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:36.708257 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:36.709058 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:36.709058 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:36.709058 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:36.709058 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:36.709058 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:36.709058 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:36.709058 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:36.709058 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:36.709058 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:36.709058 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:36.709058 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:04:36.709058 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:36.713935 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 281/553] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Sep 13 12:04:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:36.714957 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b045436-7daf-412c-bc57-946baba844ef None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:36.733304 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf72e97-c44b-48b1-8c0b-6d3fbf5935a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:36.733939 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf72e97-c44b-48b1-8c0b-6d3fbf5935a2 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:36.734222 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf72e97-c44b-48b1-8c0b-6d3fbf5935a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:36.734498 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf72e97-c44b-48b1-8c0b-6d3fbf5935a2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:36.742777 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf72e97-c44b-48b1-8c0b-6d3fbf5935a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:36.744223 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf72e97-c44b-48b1-8c0b-6d3fbf5935a2 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:36.755567 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-abf72e97-c44b-48b1-8c0b-6d3fbf5935a2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 12:04:36.755567 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:36.755567 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:36.755567 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:36.755567 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:36.755567 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:36.755567 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:36.755567 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:36.755567 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:36.755567 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:36.755567 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:36.755567 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:36.755567 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:04:36.755567 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:04:36.755567 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:04:36.755567 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:04:36.756742 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:36.756742 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:36.756742 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:04:36.756742 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:36.756742 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:04:36.756742 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:36.756742 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:36.756742 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:36.756742 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:36.756742 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:36.756742 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:36.756742 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:36.756742 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:36.756742 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:36.756742 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:36.756742 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:36.756742 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:36.756742 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:36.758011 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:36.758011 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:36.758011 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:04:36.758011 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:04:36.758011 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:04:36.758011 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:04:36.758011 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:04:36.758011 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:04:36.758011 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 12:04:36.758011 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:36.758011 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 273/554] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:36.758011 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf72e97-c44b-48b1-8c0b-6d3fbf5935a2 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:36.819354 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b045436-7daf-412c-bc57-946baba844ef None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:36.854716 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051113f5-2fb1-49c4-af20-140c62d27631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:36.855265 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051113f5-2fb1-49c4-af20-140c62d27631 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:36.855542 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051113f5-2fb1-49c4-af20-140c62d27631 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:36.855810 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051113f5-2fb1-49c4-af20-140c62d27631 None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:36.856495 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051113f5-2fb1-49c4-af20-140c62d27631 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:36.856800 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051113f5-2fb1-49c4-af20-140c62d27631 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:36.857932 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf72e97-c44b-48b1-8c0b-6d3fbf5935a2 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:36.858233 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051113f5-2fb1-49c4-af20-140c62d27631 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:36.869736 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 282/555] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Sep 13 12:04:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:36.870544 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051113f5-2fb1-49c4-af20-140c62d27631 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:36.873116 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:36.896937 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b8413-32fe-429b-a3e6-4dbd0f4c7a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:36.897542 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b8413-32fe-429b-a3e6-4dbd0f4c7a72 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:36.897819 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b8413-32fe-429b-a3e6-4dbd0f4c7a72 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:36.898094 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b8413-32fe-429b-a3e6-4dbd0f4c7a72 None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:36.898790 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b8413-32fe-429b-a3e6-4dbd0f4c7a72 None admin] RBAC: Adding query filter params (name=service) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:36.899100 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b8413-32fe-429b-a3e6-4dbd0f4c7a72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:36.900479 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b8413-32fe-429b-a3e6-4dbd0f4c7a72 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:36.909275 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 274/556] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Sep 13 12:04:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:36.910070 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b8413-32fe-429b-a3e6-4dbd0f4c7a72 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:36.941176 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:36.976178 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051113f5-2fb1-49c4-af20-140c62d27631 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:37.010377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48b39a-f613-4f1a-9b15-2a78410cffa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:37.011034 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48b39a-f613-4f1a-9b15-2a78410cffa5 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:37.011309 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48b39a-f613-4f1a-9b15-2a78410cffa5 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:37.011577 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48b39a-f613-4f1a-9b15-2a78410cffa5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:37.011729 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b8413-32fe-429b-a3e6-4dbd0f4c7a72 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:37.022545 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48b39a-f613-4f1a-9b15-2a78410cffa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:37.027766 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-5c48b39a-f613-4f1a-9b15-2a78410cffa5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:04:37.027766 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:37.027766 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:37.027766 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:37.027766 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:37.027766 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:37.027766 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:37.027766 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:37.027766 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:37.027766 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:37.027766 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:37.027766 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:37.027766 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:37.027766 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:37.027766 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:37.027766 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:37.028827 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:37.028827 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:37.028827 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:37.028827 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:37.028827 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:37.028827 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:37.028827 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:37.028827 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:37.028827 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:37.028827 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:37.028827 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:37.028827 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:37.028827 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:37.028827 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:37.028827 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:37.028827 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:37.029730 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:37.029730 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:37.029730 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:37.029730 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:37.029730 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:37.029730 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:37.029730 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:37.029730 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:37.029730 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:37.029730 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:37.029730 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:04:37.029730 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:37.029730 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 283/557] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Sep 13 12:04:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:37.029730 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48b39a-f613-4f1a-9b15-2a78410cffa5 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:37.051939 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b44f09-4c4d-4010-a77c-b2162a72a5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:37.052530 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44f09-4c4d-4010-a77c-b2162a72a5ec None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:37.052804 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44f09-4c4d-4010-a77c-b2162a72a5ec None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:37.053072 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b44f09-4c4d-4010-a77c-b2162a72a5ec None admin] PATH_INFO: `/v3/users` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:37.053790 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b44f09-4c4d-4010-a77c-b2162a72a5ec None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:37.054095 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b44f09-4c4d-4010-a77c-b2162a72a5ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:37.055551 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b44f09-4c4d-4010-a77c-b2162a72a5ec None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:37.079659 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 275/558] 10.222.0.15 () {56 vars in 1137 bytes} [Tue Sep 13 12:04:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:37.079659 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b44f09-4c4d-4010-a77c-b2162a72a5ec None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:37.098503 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:37.139351 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48b39a-f613-4f1a-9b15-2a78410cffa5 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:37.170823 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:37.175356 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ad676-887d-4130-bcc4-f2cac645261e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:37.176008 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ad676-887d-4130-bcc4-f2cac645261e None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:37.176283 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ad676-887d-4130-bcc4-f2cac645261e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:37.176551 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ad676-887d-4130-bcc4-f2cac645261e None admin] PATH_INFO: `/v3/projects/2cd599a81e8043bebfca960673e63bbc/users/e740dc7330284b0bbe6a825186f0a55d/roles/45922c768b6541549cc7b4aa2d49b0ac` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:37.180964 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b44f09-4c4d-4010-a77c-b2162a72a5ec None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:37.191691 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ad676-887d-4130-bcc4-f2cac645261e None admin] RBAC: Authorizing `identity:create_grant(project_id=2cd599a81e8043bebfca960673e63bbc, user_id=e740dc7330284b0bbe6a825186f0a55d, role_id=45922c768b6541549cc7b4aa2d49b0ac)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:37.193215 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ad676-887d-4130-bcc4-f2cac645261e None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:37.205994 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 284/559] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Sep 13 12:04:37 2022] PUT /identity/v3/projects/2cd599a81e8043bebfca960673e63bbc/users/e740dc7330284b0bbe6a825186f0a55d/roles/45922c768b6541549cc7b4aa2d49b0ac => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:04:37.206954 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ad676-887d-4130-bcc4-f2cac645261e None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:37.216009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3179f2-a55a-4122-9ed2-6f3eee126992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:37.216965 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3179f2-a55a-4122-9ed2-6f3eee126992 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:37.217408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3179f2-a55a-4122-9ed2-6f3eee126992 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:37.217830 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3179f2-a55a-4122-9ed2-6f3eee126992 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:37.231989 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3179f2-a55a-4122-9ed2-6f3eee126992 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:37.233738 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3179f2-a55a-4122-9ed2-6f3eee126992 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:37.251152 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-5a3179f2-a55a-4122-9ed2-6f3eee126992 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:37.251152 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:37.251152 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:37.251152 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:37.251152 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:37.251152 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:37.251152 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:37.251152 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:37.251152 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:37.251152 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:37.251152 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:37.251152 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:37.251152 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:37.251152 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:37.251152 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:37.251152 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:37.252404 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:37.252404 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:37.252404 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:37.252404 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:37.252404 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:37.252404 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:37.252404 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:37.252404 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:37.252404 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:37.252404 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:37.252404 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:37.252404 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:37.252404 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:37.252404 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:37.252404 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:37.252404 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:37.252404 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:37.253486 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:37.253486 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:37.253486 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:37.253486 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 276/560] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:37.253754 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3179f2-a55a-4122-9ed2-6f3eee126992 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:37.332222 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ad676-887d-4130-bcc4-f2cac645261e None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:37.348371 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:37.376628 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773ee50-4fa4-4c14-9c4a-44df2c500eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:37.377316 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773ee50-4fa4-4c14-9c4a-44df2c500eb3 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:37.377627 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773ee50-4fa4-4c14-9c4a-44df2c500eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:37.377865 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773ee50-4fa4-4c14-9c4a-44df2c500eb3 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:37.378655 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773ee50-4fa4-4c14-9c4a-44df2c500eb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:37.379242 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773ee50-4fa4-4c14-9c4a-44df2c500eb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:37.380375 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773ee50-4fa4-4c14-9c4a-44df2c500eb3 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:37.382377 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3179f2-a55a-4122-9ed2-6f3eee126992 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:37.390170 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 285/561] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Sep 13 12:04:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:37.390814 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773ee50-4fa4-4c14-9c4a-44df2c500eb3 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:37.427347 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40239b67-a230-40ca-89e2-7b23a117b8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:37.427986 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40239b67-a230-40ca-89e2-7b23a117b8a6 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:37.428458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40239b67-a230-40ca-89e2-7b23a117b8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:37.428565 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40239b67-a230-40ca-89e2-7b23a117b8a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:37.444805 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40239b67-a230-40ca-89e2-7b23a117b8a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:37.446220 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40239b67-a230-40ca-89e2-7b23a117b8a6 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:37.450432 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:37.468283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-40239b67-a230-40ca-89e2-7b23a117b8a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:37.468283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:37.468283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:37.468283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:37.468283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:37.468283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:37.468283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:37.468283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:37.468283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:37.468283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:37.468283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:37.468283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:37.468283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:37.468283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:37.468283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:37.468283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:37.469406 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:37.469406 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:37.469406 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:37.469406 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:37.469406 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:37.469406 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:37.469406 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:37.469406 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:37.469406 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:37.469406 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:37.469406 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:37.469406 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:37.469406 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:37.469406 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:37.469406 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:37.469406 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:37.469406 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:37.471207 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:37.471207 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:37.471207 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:37.471207 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 277/562] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:37.472461 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40239b67-a230-40ca-89e2-7b23a117b8a6 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:37.533575 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773ee50-4fa4-4c14-9c4a-44df2c500eb3 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:37.581945 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be913756-5df2-4111-b261-209de5a66eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:37.582565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be913756-5df2-4111-b261-209de5a66eb9 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:37.582867 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be913756-5df2-4111-b261-209de5a66eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:37.583144 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be913756-5df2-4111-b261-209de5a66eb9 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:37.583796 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be913756-5df2-4111-b261-209de5a66eb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:37.584110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be913756-5df2-4111-b261-209de5a66eb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:37.585507 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be913756-5df2-4111-b261-209de5a66eb9 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:37.597561 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40239b67-a230-40ca-89e2-7b23a117b8a6 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:37.610487 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 286/563] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:37.610487 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be913756-5df2-4111-b261-209de5a66eb9 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:37.641017 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2314d7-7623-4940-a268-9b264ed1523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:37.642234 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2314d7-7623-4940-a268-9b264ed1523a None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:37.642431 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2314d7-7623-4940-a268-9b264ed1523a None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:37.642781 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2314d7-7623-4940-a268-9b264ed1523a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:37.654744 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2314d7-7623-4940-a268-9b264ed1523a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:37.656229 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2314d7-7623-4940-a268-9b264ed1523a None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:37.658053 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:37.680873 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-2d2314d7-7623-4940-a268-9b264ed1523a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:37.680873 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:37.680873 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:37.680873 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:37.680873 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:37.680873 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:37.680873 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:37.680873 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:37.680873 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:37.680873 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:37.680873 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:37.680873 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:37.680873 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:37.680873 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:37.680873 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:37.680873 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:37.681885 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:37.681885 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:37.681885 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:37.681885 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:37.681885 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:37.681885 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:37.681885 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:37.681885 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:37.681885 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:37.681885 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:37.681885 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:37.681885 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:37.681885 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:37.681885 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:37.681885 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:37.681885 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:37.681885 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:37.683180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:37.683180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:37.683180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:37.683180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 278/564] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:37.683180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2314d7-7623-4940-a268-9b264ed1523a None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:37.747579 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:37.764701 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be913756-5df2-4111-b261-209de5a66eb9 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:37.807061 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4900a-d07b-4a80-a52f-5248b70df97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:37.808364 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4900a-d07b-4a80-a52f-5248b70df97f None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:37.808364 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4900a-d07b-4a80-a52f-5248b70df97f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:37.808364 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4900a-d07b-4a80-a52f-5248b70df97f None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:37.809272 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4900a-d07b-4a80-a52f-5248b70df97f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:37.809680 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4900a-d07b-4a80-a52f-5248b70df97f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:37.811281 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4900a-d07b-4a80-a52f-5248b70df97f None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:37.818475 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2314d7-7623-4940-a268-9b264ed1523a None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:37.827434 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 287/565] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:37.828305 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4900a-d07b-4a80-a52f-5248b70df97f None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:37.869094 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c573050-8dc1-440d-b1dd-abec1ce4af48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:37.870361 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c573050-8dc1-440d-b1dd-abec1ce4af48 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:37.870677 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c573050-8dc1-440d-b1dd-abec1ce4af48 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:37.871050 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c573050-8dc1-440d-b1dd-abec1ce4af48 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:37.884763 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c573050-8dc1-440d-b1dd-abec1ce4af48 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:37.887374 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c573050-8dc1-440d-b1dd-abec1ce4af48 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:37.905381 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-2c573050-8dc1-440d-b1dd-abec1ce4af48 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 12:04:37.905381 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:37.905381 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:37.905381 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:37.905381 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:37.905381 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:37.905381 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:37.905381 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:37.905381 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:37.905381 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:37.905381 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:37.905381 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:37.905381 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:04:37.905381 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:04:37.905381 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:04:37.905381 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:04:37.907797 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:37.907797 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:37.907797 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:04:37.907797 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:37.907797 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:04:37.907797 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:37.907797 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:37.907797 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:37.907797 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:37.907797 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:37.907797 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:37.907797 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:37.907797 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:37.907797 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:37.907797 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:37.907797 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:37.907797 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:37.907797 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:37.909248 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:37.909248 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:37.909248 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:04:37.909248 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:04:37.909248 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:04:37.909248 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:04:37.909248 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:04:37.909248 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:04:37.909248 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 12:04:37.909248 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:37.909248 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 279/566] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Sep 13 12:04:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:37.909248 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c573050-8dc1-440d-b1dd-abec1ce4af48 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:37.951876 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:37.962117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4900a-d07b-4a80-a52f-5248b70df97f None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:38.013071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78d4d0-e72c-48db-bfe2-7072f5206d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:38.014737 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78d4d0-e72c-48db-bfe2-7072f5206d66 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:38.015018 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78d4d0-e72c-48db-bfe2-7072f5206d66 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:38.015290 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78d4d0-e72c-48db-bfe2-7072f5206d66 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:38.021150 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78d4d0-e72c-48db-bfe2-7072f5206d66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:38.021459 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78d4d0-e72c-48db-bfe2-7072f5206d66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:38.022885 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78d4d0-e72c-48db-bfe2-7072f5206d66 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:38.043364 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 288/567] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:38.043364 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78d4d0-e72c-48db-bfe2-7072f5206d66 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:38.049828 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c573050-8dc1-440d-b1dd-abec1ce4af48 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:38.060281 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:38.096615 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593fc3f-12fc-4a0c-9564-75aefcef2185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:38.097361 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593fc3f-12fc-4a0c-9564-75aefcef2185 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:38.097720 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593fc3f-12fc-4a0c-9564-75aefcef2185 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:38.098061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593fc3f-12fc-4a0c-9564-75aefcef2185 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:38.105681 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593fc3f-12fc-4a0c-9564-75aefcef2185 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:38.107230 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593fc3f-12fc-4a0c-9564-75aefcef2185 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:38.119842 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-5593fc3f-12fc-4a0c-9564-75aefcef2185 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:38.119842 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:38.119842 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:38.119842 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:38.119842 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:38.119842 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:38.119842 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:38.119842 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:38.119842 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:38.119842 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:38.119842 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:38.119842 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:38.119842 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:04:38.119842 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:04:38.119842 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:04:38.121009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:04:38.121009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:38.121009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:38.121009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:38.121009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:38.121009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:38.121009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:38.121009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:38.121009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:38.121009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:38.121009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:38.121009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:38.121009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:38.121009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:38.121009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:38.121009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:38.121009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:38.122142 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:04:38.122142 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:04:38.122142 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:04:38.122142 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:04:38.122142 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:04:38.122142 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:04:38.122142 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:38.122142 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:38.125718 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 280/568] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:38.127437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593fc3f-12fc-4a0c-9564-75aefcef2185 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:38.177640 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78d4d0-e72c-48db-bfe2-7072f5206d66 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:38.225138 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984e0f8-8f95-4d7f-8c0e-223215f0a6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:38.226202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984e0f8-8f95-4d7f-8c0e-223215f0a6ac None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:38.226486 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984e0f8-8f95-4d7f-8c0e-223215f0a6ac None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:38.226801 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984e0f8-8f95-4d7f-8c0e-223215f0a6ac None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:38.227546 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984e0f8-8f95-4d7f-8c0e-223215f0a6ac None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:38.228076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984e0f8-8f95-4d7f-8c0e-223215f0a6ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:38.229996 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984e0f8-8f95-4d7f-8c0e-223215f0a6ac None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:38.262513 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593fc3f-12fc-4a0c-9564-75aefcef2185 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:38.268174 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 289/569] 10.222.0.15 () {56 vars in 1139 bytes} [Tue Sep 13 12:04:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:38.268174 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984e0f8-8f95-4d7f-8c0e-223215f0a6ac None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:38.289992 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:38.309377 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b3f14-1ebf-4938-b5ab-40b42212a2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:38.310151 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b3f14-1ebf-4938-b5ab-40b42212a2c6 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:38.310520 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b3f14-1ebf-4938-b5ab-40b42212a2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:38.310889 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b3f14-1ebf-4938-b5ab-40b42212a2c6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:38.320556 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b3f14-1ebf-4938-b5ab-40b42212a2c6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:38.322380 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b3f14-1ebf-4938-b5ab-40b42212a2c6 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:38.336865 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-256b3f14-1ebf-4938-b5ab-40b42212a2c6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 12:04:38.336865 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:38.336865 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:38.336865 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:38.336865 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:38.336865 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:38.336865 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:38.336865 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:38.336865 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:38.336865 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:38.336865 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:38.336865 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:38.336865 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:04:38.336865 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:04:38.336865 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:04:38.336865 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:04:38.337904 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:38.337904 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:38.337904 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:04:38.337904 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:38.337904 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:04:38.337904 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:38.337904 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:38.337904 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:38.337904 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:38.337904 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:38.337904 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:38.337904 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:38.337904 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:38.337904 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:38.337904 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:38.337904 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:38.337904 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:38.337904 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:38.339858 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:38.339858 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:38.339858 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:04:38.339858 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:04:38.339858 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:04:38.339858 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:04:38.339858 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:04:38.339858 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:04:38.339858 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 12:04:38.339858 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:38.339858 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 281/570] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:38.339858 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b3f14-1ebf-4938-b5ab-40b42212a2c6 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:38.378746 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:38.406102 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984e0f8-8f95-4d7f-8c0e-223215f0a6ac None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:38.449367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021757f-96dd-40d1-b25f-646b6ae1efa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:38.450041 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021757f-96dd-40d1-b25f-646b6ae1efa7 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:38.450438 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021757f-96dd-40d1-b25f-646b6ae1efa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:38.450853 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021757f-96dd-40d1-b25f-646b6ae1efa7 None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:38.451847 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021757f-96dd-40d1-b25f-646b6ae1efa7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:38.452255 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021757f-96dd-40d1-b25f-646b6ae1efa7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:38.454205 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021757f-96dd-40d1-b25f-646b6ae1efa7 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:38.468095 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 290/571] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Sep 13 12:04:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:38.468988 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021757f-96dd-40d1-b25f-646b6ae1efa7 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:38.474909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b3f14-1ebf-4938-b5ab-40b42212a2c6 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:38.520372 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9cd86-5ae6-4017-b485-274556826402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:38.521035 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9cd86-5ae6-4017-b485-274556826402 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:38.521354 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9cd86-5ae6-4017-b485-274556826402 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:38.521635 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9cd86-5ae6-4017-b485-274556826402 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:38.537781 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9cd86-5ae6-4017-b485-274556826402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:38.540670 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9cd86-5ae6-4017-b485-274556826402 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:38.557940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-77f9cd86-5ae6-4017-b485-274556826402 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:38.557940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:38.557940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:38.557940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:38.557940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:38.557940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:38.557940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:38.557940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:38.557940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:38.557940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:38.557940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:38.557940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:38.557940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:38.557940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:38.557940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:38.557940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:38.564825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:38.564825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:38.564825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:38.564825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:38.564825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:38.564825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:38.564825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:38.564825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:38.564825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:38.564825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:38.564825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:38.564825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:38.564825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:38.564825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:38.564825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:38.564825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:38.564825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:38.565981 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:38.565981 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:38.565981 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:38.565981 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 282/572] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:38.565981 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9cd86-5ae6-4017-b485-274556826402 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:38.574510 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:38.609700 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021757f-96dd-40d1-b25f-646b6ae1efa7 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:38.649958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcf53c-e126-4041-8c13-71572e7ba02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:38.650955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcf53c-e126-4041-8c13-71572e7ba02f None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:38.651228 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcf53c-e126-4041-8c13-71572e7ba02f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:38.651494 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcf53c-e126-4041-8c13-71572e7ba02f None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:38.652239 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcf53c-e126-4041-8c13-71572e7ba02f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:38.652539 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcf53c-e126-4041-8c13-71572e7ba02f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:38.653994 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcf53c-e126-4041-8c13-71572e7ba02f None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:38.674531 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:38.677922 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 291/573] 10.222.0.15 () {56 vars in 1137 bytes} [Tue Sep 13 12:04:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:38.679068 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcf53c-e126-4041-8c13-71572e7ba02f None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:38.701628 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9cd86-5ae6-4017-b485-274556826402 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:38.740937 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782fbc3-7287-412f-abf4-fe856960f9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:38.741599 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782fbc3-7287-412f-abf4-fe856960f9dd None admin] REQUEST_METHOD: `PUT` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:38.741878 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782fbc3-7287-412f-abf4-fe856960f9dd None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:38.742150 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782fbc3-7287-412f-abf4-fe856960f9dd None admin] PATH_INFO: `/v3/projects/2cd599a81e8043bebfca960673e63bbc/users/4e2b26fb30024905986a99000564b475/roles/45922c768b6541549cc7b4aa2d49b0ac` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:38.760258 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782fbc3-7287-412f-abf4-fe856960f9dd None admin] RBAC: Authorizing `identity:create_grant(project_id=2cd599a81e8043bebfca960673e63bbc, user_id=4e2b26fb30024905986a99000564b475, role_id=45922c768b6541549cc7b4aa2d49b0ac)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:38.761792 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782fbc3-7287-412f-abf4-fe856960f9dd None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:38.782844 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 283/574] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Sep 13 12:04:38 2022] PUT /identity/v3/projects/2cd599a81e8043bebfca960673e63bbc/users/4e2b26fb30024905986a99000564b475/roles/45922c768b6541549cc7b4aa2d49b0ac => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:04:38.782844 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782fbc3-7287-412f-abf4-fe856960f9dd None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:38.821337 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcf53c-e126-4041-8c13-71572e7ba02f None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:38.873879 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:38.883187 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb6af6-fbbf-437f-8d25-6986ea180a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:38.883974 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb6af6-fbbf-437f-8d25-6986ea180a27 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:38.884398 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb6af6-fbbf-437f-8d25-6986ea180a27 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:38.884996 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb6af6-fbbf-437f-8d25-6986ea180a27 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:38.885783 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb6af6-fbbf-437f-8d25-6986ea180a27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:38.886284 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb6af6-fbbf-437f-8d25-6986ea180a27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:38.887839 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb6af6-fbbf-437f-8d25-6986ea180a27 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:38.909985 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 292/575] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:38.911230 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb6af6-fbbf-437f-8d25-6986ea180a27 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:38.942391 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782fbc3-7287-412f-abf4-fe856960f9dd None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:38.988901 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:39.003587 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029f1d5-5dc4-4fe6-b8fc-d2434c8a596a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:39.004875 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029f1d5-5dc4-4fe6-b8fc-d2434c8a596a None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:39.005343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029f1d5-5dc4-4fe6-b8fc-d2434c8a596a None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:39.011030 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029f1d5-5dc4-4fe6-b8fc-d2434c8a596a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:39.030094 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029f1d5-5dc4-4fe6-b8fc-d2434c8a596a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:39.033195 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029f1d5-5dc4-4fe6-b8fc-d2434c8a596a None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:39.043979 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb6af6-fbbf-437f-8d25-6986ea180a27 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:39.056861 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-6029f1d5-5dc4-4fe6-b8fc-d2434c8a596a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:39.056861 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:39.056861 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:39.056861 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:39.056861 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:39.056861 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:39.056861 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:39.056861 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:39.056861 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:39.056861 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:39.056861 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:39.056861 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:39.056861 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:39.056861 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:39.056861 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:39.056861 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:39.058062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:39.058062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:39.058062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:39.058062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:39.058062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:39.058062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:39.058062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:39.058062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:39.058062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:39.058062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:39.058062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:39.058062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:39.058062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:39.058062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:39.058062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:39.058062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:39.058062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:39.059209 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:39.059209 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:39.059209 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:39.061589 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 284/576] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:39.067938 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029f1d5-5dc4-4fe6-b8fc-d2434c8a596a None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:39.096721 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b7b55-6899-4c79-86bd-dfa800616399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:39.097693 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b7b55-6899-4c79-86bd-dfa800616399 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:39.098131 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b7b55-6899-4c79-86bd-dfa800616399 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:39.098548 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b7b55-6899-4c79-86bd-dfa800616399 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:39.108928 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b7b55-6899-4c79-86bd-dfa800616399 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:39.111064 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b7b55-6899-4c79-86bd-dfa800616399 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:39.123837 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-946b7b55-6899-4c79-86bd-dfa800616399 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:39.123837 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:39.123837 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:39.123837 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:39.123837 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:39.123837 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:39.123837 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:39.123837 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:39.123837 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:39.123837 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:39.123837 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:39.123837 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:39.123837 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:04:39.123837 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:04:39.123837 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:04:39.125011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:04:39.125011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:39.125011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:39.125011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:39.125011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:39.125011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:39.125011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:39.125011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:39.125011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:39.125011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:39.125011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:39.125011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:39.125011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:39.125011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:39.125011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:39.125011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:39.125011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:39.126095 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:04:39.126095 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:04:39.126095 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:04:39.126095 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:04:39.126095 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:04:39.126095 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:04:39.126095 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:39.126095 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:39.126095 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 293/577] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:39.131282 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b7b55-6899-4c79-86bd-dfa800616399 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:39.202893 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:39.221335 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029f1d5-5dc4-4fe6-b8fc-d2434c8a596a None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:39.260664 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b7b55-6899-4c79-86bd-dfa800616399 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:39.269966 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843dc74-cb7b-4a3f-b871-d2695bacf42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:39.270814 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843dc74-cb7b-4a3f-b871-d2695bacf42d None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:39.271185 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843dc74-cb7b-4a3f-b871-d2695bacf42d None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:39.271555 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843dc74-cb7b-4a3f-b871-d2695bacf42d None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:39.272398 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843dc74-cb7b-4a3f-b871-d2695bacf42d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:39.272793 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843dc74-cb7b-4a3f-b871-d2695bacf42d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:39.274292 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843dc74-cb7b-4a3f-b871-d2695bacf42d None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:39.288034 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 285/578] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:39.296070 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843dc74-cb7b-4a3f-b871-d2695bacf42d None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:39.297147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c30969-dcee-4da7-afa3-0c74fecd03de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:39.298029 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c30969-dcee-4da7-afa3-0c74fecd03de None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:39.298347 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c30969-dcee-4da7-afa3-0c74fecd03de None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:39.298642 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c30969-dcee-4da7-afa3-0c74fecd03de None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:39.299362 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c30969-dcee-4da7-afa3-0c74fecd03de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:39.299672 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c30969-dcee-4da7-afa3-0c74fecd03de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:39.301123 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c30969-dcee-4da7-afa3-0c74fecd03de None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:39.319436 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 294/579] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Sep 13 12:04:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:39.320451 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c30969-dcee-4da7-afa3-0c74fecd03de None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:39.355032 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:39.449450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843dc74-cb7b-4a3f-b871-d2695bacf42d None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:39.471888 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c30969-dcee-4da7-afa3-0c74fecd03de None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:39.488495 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:39.505112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9b93b-531d-4639-9e56-90eaee1d9270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:39.506445 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9b93b-531d-4639-9e56-90eaee1d9270 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:39.506900 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9b93b-531d-4639-9e56-90eaee1d9270 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:39.507592 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9b93b-531d-4639-9e56-90eaee1d9270 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:39.519057 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9b93b-531d-4639-9e56-90eaee1d9270 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:39.521256 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9b93b-531d-4639-9e56-90eaee1d9270 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:39.522424 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0071a-ff1c-43b5-a71b-5ffecdc174f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:39.523230 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0071a-ff1c-43b5-a71b-5ffecdc174f6 None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:39.523603 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0071a-ff1c-43b5-a71b-5ffecdc174f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:39.524192 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0071a-ff1c-43b5-a71b-5ffecdc174f6 None admin] PATH_INFO: `/v3/projects/2cd599a81e8043bebfca960673e63bbc/users/2e24fc5713164917ba1368ff461e9629/roles/45922c768b6541549cc7b4aa2d49b0ac` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:39.537055 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-5ba9b93b-531d-4639-9e56-90eaee1d9270 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:39.537055 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:39.537055 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:39.537055 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:39.537055 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:39.537055 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:39.537055 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:39.537055 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:39.537055 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:39.537055 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:39.537055 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:39.537055 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:39.537055 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:04:39.537055 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:04:39.537055 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:04:39.538231 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:04:39.538231 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:39.538231 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:39.538231 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:39.538231 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:39.538231 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:39.538231 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:39.538231 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:39.538231 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:39.538231 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:39.538231 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:39.538231 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:39.538231 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:39.538231 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:39.538231 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:39.538231 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:39.538231 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:39.539384 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:04:39.539384 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:04:39.539384 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:04:39.539384 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:04:39.539384 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:04:39.539384 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:04:39.539384 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:39.539384 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:39.546841 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 286/580] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:39.548422 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9b93b-531d-4639-9e56-90eaee1d9270 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:39.562581 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0071a-ff1c-43b5-a71b-5ffecdc174f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=2cd599a81e8043bebfca960673e63bbc, user_id=2e24fc5713164917ba1368ff461e9629, role_id=45922c768b6541549cc7b4aa2d49b0ac)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:39.565238 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0071a-ff1c-43b5-a71b-5ffecdc174f6 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:39.586840 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 295/581] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Sep 13 12:04:39 2022] PUT /identity/v3/projects/2cd599a81e8043bebfca960673e63bbc/users/2e24fc5713164917ba1368ff461e9629/roles/45922c768b6541549cc7b4aa2d49b0ac => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:04:39.694971 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9b93b-531d-4639-9e56-90eaee1d9270 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:39.707584 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:39.741230 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3be2a-b8fe-4168-b867-96bb99737178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:39.742015 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3be2a-b8fe-4168-b867-96bb99737178 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:39.742407 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3be2a-b8fe-4168-b867-96bb99737178 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:39.742815 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3be2a-b8fe-4168-b867-96bb99737178 None admin] PATH_INFO: `/v3/projects` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:39.743699 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3be2a-b8fe-4168-b867-96bb99737178 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:39.744137 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3be2a-b8fe-4168-b867-96bb99737178 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:39.745724 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3be2a-b8fe-4168-b867-96bb99737178 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:39.763489 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 287/582] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Sep 13 12:04:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:39.769356 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0071a-ff1c-43b5-a71b-5ffecdc174f6 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:39.893554 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0071a-ff1c-43b5-a71b-5ffecdc174f6 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:39.937118 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7775ff-c23c-41b8-871c-d262505e6b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:39.937775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7775ff-c23c-41b8-871c-d262505e6b39 None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:39.938053 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7775ff-c23c-41b8-871c-d262505e6b39 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:39.938346 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7775ff-c23c-41b8-871c-d262505e6b39 None admin] PATH_INFO: `/v3/projects/2cd599a81e8043bebfca960673e63bbc/users/06cb1e39f474441495bc09988786a84a/roles/45922c768b6541549cc7b4aa2d49b0ac` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:39.955103 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7775ff-c23c-41b8-871c-d262505e6b39 None admin] RBAC: Authorizing `identity:create_grant(project_id=2cd599a81e8043bebfca960673e63bbc, user_id=06cb1e39f474441495bc09988786a84a, role_id=45922c768b6541549cc7b4aa2d49b0ac)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:39.956637 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7775ff-c23c-41b8-871c-d262505e6b39 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:39.972013 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 296/583] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Sep 13 12:04:39 2022] PUT /identity/v3/projects/2cd599a81e8043bebfca960673e63bbc/users/06cb1e39f474441495bc09988786a84a/roles/45922c768b6541549cc7b4aa2d49b0ac => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:04:40.093323 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372af6a-f18a-4b97-a079-1e32b8b80f36 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:40.093733 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372af6a-f18a-4b97-a079-1e32b8b80f36 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:40.094076 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372af6a-f18a-4b97-a079-1e32b8b80f36 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:40.097015 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 288/584] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:40.103020 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad39b9-2652-4a63-8c95-d376ca50b3ec None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:40.103488 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad39b9-2652-4a63-8c95-d376ca50b3ec None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:40.103893 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad39b9-2652-4a63-8c95-d376ca50b3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:40.124598 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-8cad39b9-2652-4a63-8c95-d376ca50b3ec None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:40.126470 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-8cad39b9-2652-4a63-8c95-d376ca50b3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:40.130225 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:40.209735 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 297/585] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:40.555049 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372af6a-f18a-4b97-a079-1e32b8b80f36 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:40.676337 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372af6a-f18a-4b97-a079-1e32b8b80f36 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:40.717009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a5404-e9a6-4142-868c-97c91f0af629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:40.717696 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a5404-e9a6-4142-868c-97c91f0af629 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:40.717979 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a5404-e9a6-4142-868c-97c91f0af629 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:40.718251 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a5404-e9a6-4142-868c-97c91f0af629 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:40.730246 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a5404-e9a6-4142-868c-97c91f0af629 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:40.735298 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-796a5404-e9a6-4142-868c-97c91f0af629 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:04:40.735298 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:40.735298 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:40.735298 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:40.735298 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:40.735298 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:40.735298 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:40.735298 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:40.735298 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:40.735298 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:40.735298 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:40.735298 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:40.735298 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:40.735298 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:40.735298 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:40.735298 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:40.736417 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:40.736417 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:40.736417 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:40.736417 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:40.736417 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:40.736417 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:40.736417 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:40.736417 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:40.736417 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:40.736417 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:40.736417 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:40.736417 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:40.736417 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:40.736417 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:40.736417 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:40.736417 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:40.737408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:40.737408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:40.737408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:40.737408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:40.737408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:40.737408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:40.737408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:40.737408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:40.737408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:40.737408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:40.737408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:04:40.737408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:40.737408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 289/586] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Sep 13 12:04:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:40.742803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad39b9-2652-4a63-8c95-d376ca50b3ec None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:40.873861 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad39b9-2652-4a63-8c95-d376ca50b3ec None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:40.912803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491df77-ca56-4df4-a4ca-727af67931f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:40.913428 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491df77-ca56-4df4-a4ca-727af67931f7 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:40.913706 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491df77-ca56-4df4-a4ca-727af67931f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:40.913978 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491df77-ca56-4df4-a4ca-727af67931f7 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:40.914668 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491df77-ca56-4df4-a4ca-727af67931f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:40.915048 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491df77-ca56-4df4-a4ca-727af67931f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:40.916692 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491df77-ca56-4df4-a4ca-727af67931f7 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:40.927869 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 298/587] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Sep 13 12:04:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:40.936088 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a5404-e9a6-4142-868c-97c91f0af629 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:40.960749 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:41.058900 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a5404-e9a6-4142-868c-97c91f0af629 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:41.099675 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45517a1e-2ed5-4023-a32b-7c7d851feafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:41.100304 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45517a1e-2ed5-4023-a32b-7c7d851feafb None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:41.100577 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45517a1e-2ed5-4023-a32b-7c7d851feafb None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:41.100847 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45517a1e-2ed5-4023-a32b-7c7d851feafb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:41.112270 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45517a1e-2ed5-4023-a32b-7c7d851feafb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:41.113732 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45517a1e-2ed5-4023-a32b-7c7d851feafb None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:41.136458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-45517a1e-2ed5-4023-a32b-7c7d851feafb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:41.136458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:41.136458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:41.136458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:41.136458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:41.136458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:41.136458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:41.136458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:41.136458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:41.136458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:41.136458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:41.136458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:41.136458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:41.136458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:41.136458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:41.136458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:41.137588 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:41.137588 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:41.137588 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:41.137588 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:41.137588 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:41.137588 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:41.137588 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:41.137588 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:41.137588 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:41.137588 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:41.137588 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:41.137588 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:41.137588 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:41.137588 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:41.137588 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:41.137588 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:41.137588 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:41.138699 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:41.138699 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:41.138699 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:41.138699 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 290/588] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:04:41.144875 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491df77-ca56-4df4-a4ca-727af67931f7 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:41.148265 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:41.265081 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491df77-ca56-4df4-a4ca-727af67931f7 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:41.303490 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d85a0-f52c-4211-95aa-6a615e8c8a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:41.304576 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d85a0-f52c-4211-95aa-6a615e8c8a1d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:41.305113 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d85a0-f52c-4211-95aa-6a615e8c8a1d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:41.305656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d85a0-f52c-4211-95aa-6a615e8c8a1d None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:41.306945 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d85a0-f52c-4211-95aa-6a615e8c8a1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:41.307687 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d85a0-f52c-4211-95aa-6a615e8c8a1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:41.309864 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d85a0-f52c-4211-95aa-6a615e8c8a1d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:41.323772 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 299/589] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:41.330182 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45517a1e-2ed5-4023-a32b-7c7d851feafb None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:41.421161 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:41.464238 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45517a1e-2ed5-4023-a32b-7c7d851feafb None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:41.519872 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b340ae-85a1-46a5-874c-6c1c49cf918c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:41.520513 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b340ae-85a1-46a5-874c-6c1c49cf918c None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:41.520794 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b340ae-85a1-46a5-874c-6c1c49cf918c None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:41.521064 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b340ae-85a1-46a5-874c-6c1c49cf918c None admin] PATH_INFO: `/v3/users/nova` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:41.529640 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b340ae-85a1-46a5-874c-6c1c49cf918c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:41.531276 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b340ae-85a1-46a5-874c-6c1c49cf918c None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:41.544161 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff5ec2-d7a1-4c5b-9f08-2ccbd4d06d56 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:41.544805 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff5ec2-d7a1-4c5b-9f08-2ccbd4d06d56 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:41.545002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-22b340ae-85a1-46a5-874c-6c1c49cf918c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:04:41.545002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:41.545002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:41.545002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:41.545002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:41.545002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:41.545002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:41.545002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:41.545002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:41.545002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:41.545002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:41.545002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:41.545002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:04:41.545002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:04:41.545002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:04:41.545002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:04:41.545894 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:41.545894 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:41.545894 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:04:41.545894 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:41.545894 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:04:41.545894 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:41.545894 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:41.545894 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:41.545894 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:41.545894 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:41.545894 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:41.545894 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:41.545894 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:41.545894 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:41.545894 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:41.545894 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:41.545894 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:41.545894 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:41.546934 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:41.546934 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:41.546934 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:04:41.546934 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:04:41.546934 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:04:41.546934 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:04:41.546934 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:04:41.546934 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:04:41.546934 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:04:41.546934 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:41.546934 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 291/590] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Sep 13 12:04:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:41.548684 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff5ec2-d7a1-4c5b-9f08-2ccbd4d06d56 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:41.554279 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 300/591] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:41.556051 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff5ec2-d7a1-4c5b-9f08-2ccbd4d06d56 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:41.556556 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283f8a1-c549-4ffc-8e6a-3f75ee06606a None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:41.557321 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283f8a1-c549-4ffc-8e6a-3f75ee06606a None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:41.557746 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283f8a1-c549-4ffc-8e6a-3f75ee06606a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:41.580148 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-a283f8a1-c549-4ffc-8e6a-3f75ee06606a None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:41.582418 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-a283f8a1-c549-4ffc-8e6a-3f75ee06606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:41.660096 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 292/592] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:41.678647 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:41.702334 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff5ec2-d7a1-4c5b-9f08-2ccbd4d06d56 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:41.740894 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3252b10-baa9-4a68-ba60-5fb4c08cf6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:41.741600 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3252b10-baa9-4a68-ba60-5fb4c08cf6cf None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:41.742125 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3252b10-baa9-4a68-ba60-5fb4c08cf6cf None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:41.742460 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3252b10-baa9-4a68-ba60-5fb4c08cf6cf None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:41.743294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3252b10-baa9-4a68-ba60-5fb4c08cf6cf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:41.743857 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3252b10-baa9-4a68-ba60-5fb4c08cf6cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:41.745176 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3252b10-baa9-4a68-ba60-5fb4c08cf6cf None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:41.767679 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 301/593] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Sep 13 12:04:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:41.773185 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283f8a1-c549-4ffc-8e6a-3f75ee06606a None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:41.843904 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:41.892767 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283f8a1-c549-4ffc-8e6a-3f75ee06606a None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:41.935872 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371fe97-1f3c-49a9-9431-a6b46c0ebaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:41.936405 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371fe97-1f3c-49a9-9431-a6b46c0ebaad None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:41.936679 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371fe97-1f3c-49a9-9431-a6b46c0ebaad None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:41.936944 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371fe97-1f3c-49a9-9431-a6b46c0ebaad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:42.007434 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3252b10-baa9-4a68-ba60-5fb4c08cf6cf None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:42.024502 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371fe97-1f3c-49a9-9431-a6b46c0ebaad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:42.026434 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371fe97-1f3c-49a9-9431-a6b46c0ebaad None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:42.116223 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:42.130347 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3252b10-baa9-4a68-ba60-5fb4c08cf6cf None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:42.155134 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:42.181247 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1207c2c-a94d-4b55-b3f8-971c554748dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:42.183607 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1207c2c-a94d-4b55-b3f8-971c554748dc None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:42.184378 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1207c2c-a94d-4b55-b3f8-971c554748dc None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:42.184854 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1207c2c-a94d-4b55-b3f8-971c554748dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:42.186970 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 293/594] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:04:42.200729 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371fe97-1f3c-49a9-9431-a6b46c0ebaad None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:42.206640 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1207c2c-a94d-4b55-b3f8-971c554748dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:42.209612 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-e1207c2c-a94d-4b55-b3f8-971c554748dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:04:42.209612 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:42.209612 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:42.209612 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:42.209612 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:42.209612 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:42.209612 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:42.209612 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:42.209612 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:42.209612 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:42.209612 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:42.209612 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:42.209612 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:42.209612 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:42.209612 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:42.209612 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:42.210547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:42.210547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:42.210547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:42.210547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:42.210547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:42.210547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:42.210547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:42.210547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:42.210547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:42.210547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:42.210547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:42.210547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:42.210547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:42.210547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:42.210547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:42.210547 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:42.211685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:42.211685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:42.211685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:42.211685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:42.211685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:42.211685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:42.211685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:42.211685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:42.211685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:42.211685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:42.211685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:04:42.211685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:42.214239 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 302/595] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Sep 13 12:04:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:04:42.224423 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1207c2c-a94d-4b55-b3f8-971c554748dc None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:42.350442 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371fe97-1f3c-49a9-9431-a6b46c0ebaad None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:42.390290 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1207c2c-a94d-4b55-b3f8-971c554748dc None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:42.395026 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7656c5e-845d-4ce4-94a6-fd14543bb5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:42.396060 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7656c5e-845d-4ce4-94a6-fd14543bb5bf None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:42.396539 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7656c5e-845d-4ce4-94a6-fd14543bb5bf None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:42.396992 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7656c5e-845d-4ce4-94a6-fd14543bb5bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:42.409493 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7656c5e-845d-4ce4-94a6-fd14543bb5bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:42.410991 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7656c5e-845d-4ce4-94a6-fd14543bb5bf None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:42.435123 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba26a08-4ce4-444c-b7b9-28fde5e2c23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:42.435451 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-f7656c5e-845d-4ce4-94a6-fd14543bb5bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:42.435451 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:42.435451 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:42.435451 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:42.435451 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:42.435451 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:42.435451 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:42.435451 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:42.435451 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:42.435451 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:42.435451 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:42.435451 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:42.435451 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:42.435451 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:42.435451 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:42.435451 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:42.437229 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:42.437229 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:42.437229 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:42.437229 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:42.437229 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:42.437229 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:42.437229 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:42.437229 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:42.437229 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:42.437229 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:42.437229 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:42.437229 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:42.437229 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:42.437229 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:42.437229 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:42.437229 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:42.437229 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:42.438913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:42.438913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:42.438913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:42.439226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba26a08-4ce4-444c-b7b9-28fde5e2c23d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:42.439226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba26a08-4ce4-444c-b7b9-28fde5e2c23d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:42.439226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba26a08-4ce4-444c-b7b9-28fde5e2c23d None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:42.439609 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 294/596] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:04:42.439609 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72862b73-b03e-4978-9a58-0f0c8421c292 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:42.439609 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72862b73-b03e-4978-9a58-0f0c8421c292 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:42.439609 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72862b73-b03e-4978-9a58-0f0c8421c292 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:42.443083 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 295/597] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:42.443190 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba26a08-4ce4-444c-b7b9-28fde5e2c23d None admin] RBAC: Adding query filter params (name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:42.443271 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72862b73-b03e-4978-9a58-0f0c8421c292 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:42.443341 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba26a08-4ce4-444c-b7b9-28fde5e2c23d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:42.443745 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba26a08-4ce4-444c-b7b9-28fde5e2c23d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:42.453559 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 303/598] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Sep 13 12:04:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:42.454911 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e0a72-e73f-4156-9b0a-50728905936b None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:42.455300 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e0a72-e73f-4156-9b0a-50728905936b None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:42.455584 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e0a72-e73f-4156-9b0a-50728905936b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:42.466911 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:42.477707 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-fb5e0a72-e73f-4156-9b0a-50728905936b None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:42.479049 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-fb5e0a72-e73f-4156-9b0a-50728905936b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:42.528662 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:42.570053 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 304/599] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:42.571554 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e0a72-e73f-4156-9b0a-50728905936b None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:42.588366 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72862b73-b03e-4978-9a58-0f0c8421c292 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:42.638467 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc0ac1-0cb2-412d-8b7c-80a8600e3659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:42.639113 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc0ac1-0cb2-412d-8b7c-80a8600e3659 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:42.639391 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc0ac1-0cb2-412d-8b7c-80a8600e3659 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:42.639775 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc0ac1-0cb2-412d-8b7c-80a8600e3659 None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:42.640356 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc0ac1-0cb2-412d-8b7c-80a8600e3659 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:42.640661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc0ac1-0cb2-412d-8b7c-80a8600e3659 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:42.642905 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc0ac1-0cb2-412d-8b7c-80a8600e3659 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:42.660230 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 296/600] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:42.660230 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca879ba4-fe9a-4b44-83d1-d7e5aee2938f None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:42.660230 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca879ba4-fe9a-4b44-83d1-d7e5aee2938f None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:42.660230 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca879ba4-fe9a-4b44-83d1-d7e5aee2938f None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:42.660230 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 297/601] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:42.661394 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca879ba4-fe9a-4b44-83d1-d7e5aee2938f None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:42.711894 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e0a72-e73f-4156-9b0a-50728905936b None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:42.758604 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a2965-80bc-4a4d-89cc-bb67fc53600c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:42.759322 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a2965-80bc-4a4d-89cc-bb67fc53600c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:42.759537 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a2965-80bc-4a4d-89cc-bb67fc53600c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:42.759812 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a2965-80bc-4a4d-89cc-bb67fc53600c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:42.770439 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:42.775135 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a2965-80bc-4a4d-89cc-bb67fc53600c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:42.776604 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a2965-80bc-4a4d-89cc-bb67fc53600c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:42.793599 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-6d9a2965-80bc-4a4d-89cc-bb67fc53600c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:42.793599 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:42.793599 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:42.793599 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:42.793599 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:42.793599 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:42.793599 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:42.793599 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:42.793599 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:42.793599 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:42.793599 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:42.793599 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:42.793599 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:42.793599 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:42.793599 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:42.793599 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:42.797056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:42.797056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:42.797056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:42.797056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:42.797056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:42.797056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:42.797056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:42.797056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:42.797056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:42.797056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:42.797056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:42.797056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:42.797056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:42.797056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:42.797056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:42.797056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:42.797056 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:42.798021 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:42.798021 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:42.798021 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:42.799089 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 305/602] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:42.800459 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf0e90-ba47-485e-ab68-36cd5540fd85 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:42.800749 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf0e90-ba47-485e-ab68-36cd5540fd85 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:42.801021 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf0e90-ba47-485e-ab68-36cd5540fd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:42.806897 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca879ba4-fe9a-4b44-83d1-d7e5aee2938f None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:42.819148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-4ccf0e90-ba47-485e-ab68-36cd5540fd85 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:42.820353 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-4ccf0e90-ba47-485e-ab68-36cd5540fd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:42.841410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:42.850308 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21a1b5-47ea-41b1-a149-f4fa38234acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:42.851063 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21a1b5-47ea-41b1-a149-f4fa38234acd None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:42.851345 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21a1b5-47ea-41b1-a149-f4fa38234acd None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:42.851625 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21a1b5-47ea-41b1-a149-f4fa38234acd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:42.858775 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21a1b5-47ea-41b1-a149-f4fa38234acd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:42.860389 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21a1b5-47ea-41b1-a149-f4fa38234acd None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:42.872314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-ce21a1b5-47ea-41b1-a149-f4fa38234acd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:42.872314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:42.872314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:42.872314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:42.872314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:42.872314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:42.872314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:42.872314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:42.872314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:42.872314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:42.872314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:42.872314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:42.872314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:04:42.872314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:04:42.872314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:04:42.873265 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:04:42.873265 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:42.873265 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:42.873265 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:42.873265 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:42.873265 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:42.873265 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:42.873265 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:42.873265 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:42.873265 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:42.873265 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:42.873265 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:42.873265 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:42.873265 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:42.873265 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:42.873265 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:42.873265 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:42.874157 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:04:42.874157 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:04:42.874157 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:04:42.874157 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:04:42.874157 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:04:42.874157 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:04:42.874157 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:42.874157 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:42.874157 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 298/603] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:42.874157 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21a1b5-47ea-41b1-a149-f4fa38234acd None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:42.909106 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 306/604] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:42.909689 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf0e90-ba47-485e-ab68-36cd5540fd85 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:42.999300 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21a1b5-47ea-41b1-a149-f4fa38234acd None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:43.028047 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf0e90-ba47-485e-ab68-36cd5540fd85 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:43.043011 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cd3eb-13d4-4ebb-a348-b26d3c7d3154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:43.043985 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cd3eb-13d4-4ebb-a348-b26d3c7d3154 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:43.044567 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cd3eb-13d4-4ebb-a348-b26d3c7d3154 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:43.045043 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cd3eb-13d4-4ebb-a348-b26d3c7d3154 None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:43.045916 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383cd3eb-13d4-4ebb-a348-b26d3c7d3154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:43.046433 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383cd3eb-13d4-4ebb-a348-b26d3c7d3154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:43.048421 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383cd3eb-13d4-4ebb-a348-b26d3c7d3154 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:43.050678 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:43.068368 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975258e-1ad6-4372-bb0e-5e2666561a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:43.068779 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 299/605] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:43.069241 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975258e-1ad6-4372-bb0e-5e2666561a56 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:43.069520 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975258e-1ad6-4372-bb0e-5e2666561a56 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:43.069696 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cd3eb-13d4-4ebb-a348-b26d3c7d3154 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:43.069817 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975258e-1ad6-4372-bb0e-5e2666561a56 None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:43.070476 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975258e-1ad6-4372-bb0e-5e2666561a56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:43.070808 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975258e-1ad6-4372-bb0e-5e2666561a56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:43.072234 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975258e-1ad6-4372-bb0e-5e2666561a56 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:43.085978 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 307/606] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Sep 13 12:04:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:43.086912 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975258e-1ad6-4372-bb0e-5e2666561a56 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:43.103825 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:43.186449 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cd3eb-13d4-4ebb-a348-b26d3c7d3154 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:43.205695 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975258e-1ad6-4372-bb0e-5e2666561a56 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:43.227945 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ad813-d323-4204-be8c-9038bad5a8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:43.228702 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ad813-d323-4204-be8c-9038bad5a8f2 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:43.228976 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ad813-d323-4204-be8c-9038bad5a8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:43.229246 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ad813-d323-4204-be8c-9038bad5a8f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:43.245277 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254c099-687a-4800-88be-22e1a06ef71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:43.245656 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ad813-d323-4204-be8c-9038bad5a8f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:43.245915 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254c099-687a-4800-88be-22e1a06ef71c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:43.246197 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254c099-687a-4800-88be-22e1a06ef71c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:43.246477 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254c099-687a-4800-88be-22e1a06ef71c None admin] PATH_INFO: `/v3/users/glance` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:43.253039 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-5c5ad813-d323-4204-be8c-9038bad5a8f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:04:43.253039 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:43.253039 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:43.253039 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:43.253039 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:43.253039 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:43.253039 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:43.253039 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:43.253039 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:43.253039 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:43.253039 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:43.253039 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:43.253039 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:43.253039 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:43.253039 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:43.253039 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:43.254524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:43.254524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:43.254524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:43.254524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:43.254524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:43.254524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:43.254524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:43.254524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:43.254524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:43.254524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:43.254524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:43.254524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:43.254524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:43.254524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:43.254524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:43.254524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:43.255925 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:43.255925 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:43.255925 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:43.255925 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:43.255925 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:43.255925 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:43.255925 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:43.255925 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:43.255925 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:43.255925 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:43.255925 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:04:43.255925 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:43.255925 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 300/607] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Sep 13 12:04:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:43.255925 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ad813-d323-4204-be8c-9038bad5a8f2 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:43.258177 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254c099-687a-4800-88be-22e1a06ef71c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:43.259749 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254c099-687a-4800-88be-22e1a06ef71c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:43.272232 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-c254c099-687a-4800-88be-22e1a06ef71c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 12:04:43.272232 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:43.272232 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:43.272232 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:43.272232 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:43.272232 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:43.272232 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:43.272232 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:43.272232 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:43.272232 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:43.272232 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:43.272232 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:43.272232 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:04:43.272232 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:04:43.272232 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:04:43.272232 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:04:43.273421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:43.273421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:43.273421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:04:43.273421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:43.273421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:04:43.273421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:43.273421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:43.273421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:43.273421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:43.273421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:43.273421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:43.273421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:43.273421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:43.273421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:43.273421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:43.273421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:43.273421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:43.273421 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:43.274565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:43.274565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:43.274565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:04:43.274565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:04:43.274565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:04:43.274565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:04:43.274565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:04:43.274565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:04:43.274565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 12:04:43.274565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:43.274565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 308/608] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:43.274565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254c099-687a-4800-88be-22e1a06ef71c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:43.320942 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:43.356822 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:43.367695 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ad813-d323-4204-be8c-9038bad5a8f2 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:43.386020 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254c099-687a-4800-88be-22e1a06ef71c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:43.404831 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd22b79-ba7f-41c4-8c77-d0e061797cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:43.405433 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd22b79-ba7f-41c4-8c77-d0e061797cbe None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:43.405710 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd22b79-ba7f-41c4-8c77-d0e061797cbe None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:43.405982 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd22b79-ba7f-41c4-8c77-d0e061797cbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:43.406751 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd22b79-ba7f-41c4-8c77-d0e061797cbe None admin] RBAC: Adding query filter params (role.id=45922c768b6541549cc7b4aa2d49b0ac, scope.project.id=2cd599a81e8043bebfca960673e63bbc, user.id=e740dc7330284b0bbe6a825186f0a55d) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:43.407063 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd22b79-ba7f-41c4-8c77-d0e061797cbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:43.408506 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd22b79-ba7f-41c4-8c77-d0e061797cbe None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:43.414724 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 301/609] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:04:43 2022] GET /identity/v3/role_assignments?user.id=e740dc7330284b0bbe6a825186f0a55d&scope.project.id=2cd599a81e8043bebfca960673e63bbc&role.id=45922c768b6541549cc7b4aa2d49b0ac => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:43.415786 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd22b79-ba7f-41c4-8c77-d0e061797cbe None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:43.423650 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bc2b7-403e-4e24-8da2-a632a506a374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:43.424479 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bc2b7-403e-4e24-8da2-a632a506a374 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:43.424864 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bc2b7-403e-4e24-8da2-a632a506a374 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:43.425239 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bc2b7-403e-4e24-8da2-a632a506a374 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:43.442803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1bc2b7-403e-4e24-8da2-a632a506a374 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:43.449137 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-7d1bc2b7-403e-4e24-8da2-a632a506a374 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:04:43.449137 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:43.449137 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:43.449137 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:43.449137 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:43.449137 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:43.449137 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:43.449137 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:43.449137 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:43.449137 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:43.449137 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:43.449137 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:43.449137 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:43.449137 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:43.449137 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:43.449137 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:43.450226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:43.450226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:43.450226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:43.450226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:43.450226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:43.450226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:43.450226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:43.450226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:43.450226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:43.450226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:43.450226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:43.450226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:43.450226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:43.450226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:43.450226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:43.450226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:43.451268 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:43.451268 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:43.451268 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:43.451268 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:43.451268 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:43.451268 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:43.451268 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:43.451268 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:43.451268 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:43.451268 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:43.451268 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:04:43.451268 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:43.452334 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 309/610] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Sep 13 12:04:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:43.453257 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bc2b7-403e-4e24-8da2-a632a506a374 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:43.550443 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd22b79-ba7f-41c4-8c77-d0e061797cbe None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:43.574320 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:43.592827 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bc2b7-403e-4e24-8da2-a632a506a374 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:43.594599 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f049c37-7564-40e7-8646-86daa72dc1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:43.596197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f049c37-7564-40e7-8646-86daa72dc1f6 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:43.596197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f049c37-7564-40e7-8646-86daa72dc1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:43.596197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f049c37-7564-40e7-8646-86daa72dc1f6 None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:43.596773 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f049c37-7564-40e7-8646-86daa72dc1f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:43.597147 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f049c37-7564-40e7-8646-86daa72dc1f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:43.598567 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f049c37-7564-40e7-8646-86daa72dc1f6 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:43.609968 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 302/611] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Sep 13 12:04:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:43.611100 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f049c37-7564-40e7-8646-86daa72dc1f6 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:43.642701 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf8876-3872-4b69-a241-04b9d12a90ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:43.643333 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf8876-3872-4b69-a241-04b9d12a90ff None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:43.643612 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf8876-3872-4b69-a241-04b9d12a90ff None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:43.643886 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf8876-3872-4b69-a241-04b9d12a90ff None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:43.644621 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf8876-3872-4b69-a241-04b9d12a90ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:43.644941 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf8876-3872-4b69-a241-04b9d12a90ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:43.646450 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf8876-3872-4b69-a241-04b9d12a90ff None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:43.648462 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:43.672407 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 310/612] 10.222.0.15 () {56 vars in 1137 bytes} [Tue Sep 13 12:04:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:43.672561 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf8876-3872-4b69-a241-04b9d12a90ff None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:43.755900 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f049c37-7564-40e7-8646-86daa72dc1f6 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:43.803232 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf8876-3872-4b69-a241-04b9d12a90ff None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:43.803733 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed17d4-5159-460d-af48-925f02ee53d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:43.804344 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed17d4-5159-460d-af48-925f02ee53d1 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:43.804636 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed17d4-5159-460d-af48-925f02ee53d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:43.804911 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed17d4-5159-460d-af48-925f02ee53d1 None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:43.805591 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed17d4-5159-460d-af48-925f02ee53d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:43.805895 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed17d4-5159-460d-af48-925f02ee53d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:43.807318 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed17d4-5159-460d-af48-925f02ee53d1 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:43.819010 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 303/613] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Sep 13 12:04:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:43.819877 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed17d4-5159-460d-af48-925f02ee53d1 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:43.851998 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240db95a-3ce4-4bf4-873e-e08bde8fb281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:43.853064 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240db95a-3ce4-4bf4-873e-e08bde8fb281 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:43.853498 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240db95a-3ce4-4bf4-873e-e08bde8fb281 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:43.853930 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240db95a-3ce4-4bf4-873e-e08bde8fb281 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:43.871614 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240db95a-3ce4-4bf4-873e-e08bde8fb281 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:43.874253 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240db95a-3ce4-4bf4-873e-e08bde8fb281 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:43.881249 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:43.893019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-240db95a-3ce4-4bf4-873e-e08bde8fb281 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:43.893019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:43.893019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:43.893019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:43.893019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:43.893019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:43.893019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:43.893019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:43.893019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:43.893019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:43.893019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:43.893019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:43.893019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:43.893019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:43.893019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:43.893019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:43.894054 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:43.894054 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:43.894054 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:43.894054 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:43.894054 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:43.894054 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:43.894054 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:43.894054 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:43.894054 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:43.894054 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:43.894054 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:43.894054 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:43.894054 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:43.894054 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:43.894054 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:43.894054 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:43.894054 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:43.895029 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:43.895029 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:43.895029 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:43.898948 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 311/614] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:43.899877 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240db95a-3ce4-4bf4-873e-e08bde8fb281 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:43.949027 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed17d4-5159-460d-af48-925f02ee53d1 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:43.954256 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:43.994094 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243445d-a481-434f-9b44-532d0ff4bdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:43.994739 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243445d-a481-434f-9b44-532d0ff4bdf1 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:43.995020 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243445d-a481-434f-9b44-532d0ff4bdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:43.995563 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243445d-a481-434f-9b44-532d0ff4bdf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:44.032611 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240db95a-3ce4-4bf4-873e-e08bde8fb281 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:44.070517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced74d69-3955-4d1e-8ba9-d10d065efe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:44.071121 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced74d69-3955-4d1e-8ba9-d10d065efe8a None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:44.071403 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced74d69-3955-4d1e-8ba9-d10d065efe8a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:44.071673 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced74d69-3955-4d1e-8ba9-d10d065efe8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:44.072185 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243445d-a481-434f-9b44-532d0ff4bdf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:44.073628 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243445d-a481-434f-9b44-532d0ff4bdf1 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:44.085915 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced74d69-3955-4d1e-8ba9-d10d065efe8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:44.087406 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced74d69-3955-4d1e-8ba9-d10d065efe8a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:44.103687 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-ced74d69-3955-4d1e-8ba9-d10d065efe8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:44.103687 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:44.103687 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:44.103687 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:44.103687 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:44.103687 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:44.103687 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:44.103687 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:44.103687 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:44.103687 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:44.103687 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:44.103687 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:44.103687 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:44.103687 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:44.103687 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:44.103687 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:44.104715 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:44.104715 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:44.104715 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:44.104715 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:44.104715 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:44.104715 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:44.104715 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:44.104715 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:44.104715 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:44.104715 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:44.104715 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:44.104715 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:44.104715 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:44.104715 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:44.104715 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:44.104715 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:44.104715 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:44.105632 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:44.105632 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:44.105632 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:44.105632 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 312/615] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:44.105632 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced74d69-3955-4d1e-8ba9-d10d065efe8a None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:44.132349 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:44.196300 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 304/616] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:04:44.197101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243445d-a481-434f-9b44-532d0ff4bdf1 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:44.241449 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:44.250892 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced74d69-3955-4d1e-8ba9-d10d065efe8a None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:44.293386 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a9a6b-8552-4f94-bff1-0dafedbd559a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:44.294044 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a9a6b-8552-4f94-bff1-0dafedbd559a None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:44.294325 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a9a6b-8552-4f94-bff1-0dafedbd559a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:44.294588 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a9a6b-8552-4f94-bff1-0dafedbd559a None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:44.295295 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a9a6b-8552-4f94-bff1-0dafedbd559a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:44.295597 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a9a6b-8552-4f94-bff1-0dafedbd559a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:44.297018 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a9a6b-8552-4f94-bff1-0dafedbd559a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:44.316684 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 313/617] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:44.316684 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a9a6b-8552-4f94-bff1-0dafedbd559a None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:44.334725 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243445d-a481-434f-9b44-532d0ff4bdf1 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:44.371440 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50de98-40f0-4b01-8a78-9d6288caa853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:44.372055 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50de98-40f0-4b01-8a78-9d6288caa853 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:44.372340 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50de98-40f0-4b01-8a78-9d6288caa853 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:44.372616 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50de98-40f0-4b01-8a78-9d6288caa853 None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:44.373276 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50de98-40f0-4b01-8a78-9d6288caa853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:44.373589 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50de98-40f0-4b01-8a78-9d6288caa853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:44.375005 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50de98-40f0-4b01-8a78-9d6288caa853 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:44.387331 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 305/618] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:44.388221 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50de98-40f0-4b01-8a78-9d6288caa853 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:44.390870 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:44.449996 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a9a6b-8552-4f94-bff1-0dafedbd559a None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:44.497798 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19bc80-f968-43dd-b3dd-1c669f057a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:44.498433 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19bc80-f968-43dd-b3dd-1c669f057a34 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:44.498748 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19bc80-f968-43dd-b3dd-1c669f057a34 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:44.499025 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19bc80-f968-43dd-b3dd-1c669f057a34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:44.514905 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19bc80-f968-43dd-b3dd-1c669f057a34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:44.517568 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19bc80-f968-43dd-b3dd-1c669f057a34 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:44.524973 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50de98-40f0-4b01-8a78-9d6288caa853 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:44.534437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-df19bc80-f968-43dd-b3dd-1c669f057a34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:44.534437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:44.534437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:44.534437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:44.534437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:44.534437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:44.534437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:44.534437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:44.534437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:44.534437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:44.534437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:44.534437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:44.534437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:44.534437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:44.534437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:44.534437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:44.535425 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:44.535425 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:44.535425 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:44.535425 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:44.535425 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:44.535425 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:44.535425 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:44.535425 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:44.535425 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:44.535425 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:44.535425 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:44.535425 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:44.535425 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:44.535425 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:44.535425 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:44.535425 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:44.535425 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:44.536303 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:44.536303 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:44.536303 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:44.536303 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 314/619] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:44.536524 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19bc80-f968-43dd-b3dd-1c669f057a34 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:44.553857 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:44.569611 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce393de8-4594-45af-be83-7935f334f758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:44.570393 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce393de8-4594-45af-be83-7935f334f758 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:44.570762 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce393de8-4594-45af-be83-7935f334f758 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:44.571108 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce393de8-4594-45af-be83-7935f334f758 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:44.580274 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce393de8-4594-45af-be83-7935f334f758 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:44.581896 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce393de8-4594-45af-be83-7935f334f758 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:44.595329 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-ce393de8-4594-45af-be83-7935f334f758 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 12:04:44.595329 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:44.595329 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:44.595329 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:44.595329 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:44.595329 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:44.595329 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:44.595329 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:44.595329 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:44.595329 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:44.595329 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:44.595329 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:44.595329 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:04:44.595329 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:04:44.595329 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:04:44.595329 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:04:44.597099 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:44.597099 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:44.597099 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:04:44.597099 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:44.597099 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:04:44.597099 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:44.597099 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:44.597099 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:44.597099 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:44.597099 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:44.597099 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:44.597099 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:44.597099 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:44.597099 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:44.597099 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:44.597099 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:44.597099 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:44.597099 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:44.598290 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:44.598290 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:44.598290 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:04:44.598290 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:04:44.598290 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:04:44.598290 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:04:44.598290 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:04:44.598290 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:04:44.598290 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 12:04:44.598290 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:44.598290 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 306/620] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Sep 13 12:04:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:44.598290 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce393de8-4594-45af-be83-7935f334f758 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:44.685410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19bc80-f968-43dd-b3dd-1c669f057a34 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:44.693906 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:44.725501 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27267984-def4-43af-9fdc-dc4b2595d60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:44.726220 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27267984-def4-43af-9fdc-dc4b2595d60c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:44.726566 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27267984-def4-43af-9fdc-dc4b2595d60c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:44.726967 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27267984-def4-43af-9fdc-dc4b2595d60c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:44.735034 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27267984-def4-43af-9fdc-dc4b2595d60c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:44.736168 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce393de8-4594-45af-be83-7935f334f758 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:44.737630 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27267984-def4-43af-9fdc-dc4b2595d60c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:44.749449 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-27267984-def4-43af-9fdc-dc4b2595d60c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 12:04:44.749449 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:44.749449 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:44.749449 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:44.749449 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:44.749449 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:44.749449 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:44.749449 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:44.749449 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:44.749449 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:44.749449 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:44.749449 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:44.749449 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:04:44.749449 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:04:44.749449 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:04:44.749449 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:04:44.750417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:44.750417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:44.750417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:04:44.750417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:44.750417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:04:44.750417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:44.750417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:44.750417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:44.750417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:44.750417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:44.750417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:44.750417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:44.750417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:44.750417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:44.750417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:44.750417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:44.750417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:44.750417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:44.752658 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:44.752658 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:44.752658 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:04:44.752658 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:04:44.752658 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:04:44.752658 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:04:44.752658 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:04:44.752658 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:04:44.752658 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 12:04:44.752658 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:44.752658 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 315/621] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:44.756339 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27267984-def4-43af-9fdc-dc4b2595d60c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:44.775592 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593984bd-793f-4407-a3e9-8478d446fae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:44.776260 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593984bd-793f-4407-a3e9-8478d446fae6 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:44.776546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593984bd-793f-4407-a3e9-8478d446fae6 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:44.776819 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593984bd-793f-4407-a3e9-8478d446fae6 None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:44.777467 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593984bd-793f-4407-a3e9-8478d446fae6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:44.777767 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593984bd-793f-4407-a3e9-8478d446fae6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:44.779301 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593984bd-793f-4407-a3e9-8478d446fae6 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:44.793439 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 307/622] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:44.794112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593984bd-793f-4407-a3e9-8478d446fae6 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:44.833940 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:44.874013 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27267984-def4-43af-9fdc-dc4b2595d60c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:44.903123 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593984bd-793f-4407-a3e9-8478d446fae6 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:44.909307 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed4641-4df5-4e0b-9cc1-42eb3201b4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:44.909917 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed4641-4df5-4e0b-9cc1-42eb3201b4b5 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:44.910302 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed4641-4df5-4e0b-9cc1-42eb3201b4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:44.910584 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed4641-4df5-4e0b-9cc1-42eb3201b4b5 None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:44.911363 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed4641-4df5-4e0b-9cc1-42eb3201b4b5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:44.911670 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed4641-4df5-4e0b-9cc1-42eb3201b4b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:44.913202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed4641-4df5-4e0b-9cc1-42eb3201b4b5 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:44.928106 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:44.933376 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 316/623] 10.222.0.15 () {56 vars in 1139 bytes} [Tue Sep 13 12:04:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:44.934233 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed4641-4df5-4e0b-9cc1-42eb3201b4b5 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:44.946996 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809e222-fb90-4925-b674-7ba4d0be1396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:44.947647 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809e222-fb90-4925-b674-7ba4d0be1396 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:44.947944 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809e222-fb90-4925-b674-7ba4d0be1396 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:44.948213 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809e222-fb90-4925-b674-7ba4d0be1396 None admin] PATH_INFO: `/v3/users` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:44.948932 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809e222-fb90-4925-b674-7ba4d0be1396 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:44.949231 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809e222-fb90-4925-b674-7ba4d0be1396 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:44.950884 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809e222-fb90-4925-b674-7ba4d0be1396 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:44.974695 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 308/624] 10.222.0.15 () {56 vars in 1137 bytes} [Tue Sep 13 12:04:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:44.975504 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809e222-fb90-4925-b674-7ba4d0be1396 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:45.041102 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed4641-4df5-4e0b-9cc1-42eb3201b4b5 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:45.070322 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:45.081854 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae60e75-e5d0-401f-9c7d-fd6494491602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:45.082106 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809e222-fb90-4925-b674-7ba4d0be1396 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:45.082487 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae60e75-e5d0-401f-9c7d-fd6494491602 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:45.082801 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae60e75-e5d0-401f-9c7d-fd6494491602 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:45.083076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae60e75-e5d0-401f-9c7d-fd6494491602 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:45.090110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae60e75-e5d0-401f-9c7d-fd6494491602 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:45.091638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae60e75-e5d0-401f-9c7d-fd6494491602 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:45.102890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-aae60e75-e5d0-401f-9c7d-fd6494491602 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:45.102890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:45.102890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:45.102890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:45.102890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:45.102890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:45.102890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:45.102890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:45.102890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:45.102890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:45.102890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:45.102890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:45.102890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:04:45.102890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:04:45.102890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:04:45.103958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:04:45.103958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:45.103958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:45.103958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:45.103958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:45.103958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:45.103958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:45.103958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:45.103958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:45.103958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:45.103958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:45.103958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:45.103958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:45.103958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:45.103958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:45.103958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:45.103958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:45.104846 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:04:45.104846 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:04:45.104846 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:04:45.104846 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:04:45.104846 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:04:45.104846 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:04:45.104846 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:45.104846 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:45.104846 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 317/625] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:45.105332 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae60e75-e5d0-401f-9c7d-fd6494491602 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:45.123162 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a609d-ea12-4fa7-b519-789ab733d096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:45.123766 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a609d-ea12-4fa7-b519-789ab733d096 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:45.124094 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a609d-ea12-4fa7-b519-789ab733d096 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:45.124336 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a609d-ea12-4fa7-b519-789ab733d096 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:45.193538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:45.220189 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a609d-ea12-4fa7-b519-789ab733d096 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:45.221856 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a609d-ea12-4fa7-b519-789ab733d096 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:45.248800 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae60e75-e5d0-401f-9c7d-fd6494491602 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:45.303448 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6acc9b-1106-450e-9723-c700f3e3a06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:45.304787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6acc9b-1106-450e-9723-c700f3e3a06b None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:45.305523 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6acc9b-1106-450e-9723-c700f3e3a06b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:45.306002 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6acc9b-1106-450e-9723-c700f3e3a06b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:45.394416 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 309/626] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:04:45.395714 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a609d-ea12-4fa7-b519-789ab733d096 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:45.406849 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:45.426687 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6acc9b-1106-450e-9723-c700f3e3a06b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:45.428352 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6acc9b-1106-450e-9723-c700f3e3a06b None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:45.492583 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:45.523246 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a609d-ea12-4fa7-b519-789ab733d096 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:45.566379 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 318/627] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:04:45.567411 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6acc9b-1106-450e-9723-c700f3e3a06b None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:45.575519 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71001466-cc6f-4d65-b406-0fb17c29473b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:45.576130 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71001466-cc6f-4d65-b406-0fb17c29473b None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:45.576408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71001466-cc6f-4d65-b406-0fb17c29473b None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:45.576677 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71001466-cc6f-4d65-b406-0fb17c29473b None admin] PATH_INFO: `/v3/projects` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:45.577375 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71001466-cc6f-4d65-b406-0fb17c29473b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:45.577681 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71001466-cc6f-4d65-b406-0fb17c29473b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:45.579288 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71001466-cc6f-4d65-b406-0fb17c29473b None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:45.591587 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 310/628] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Sep 13 12:04:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:45.592240 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71001466-cc6f-4d65-b406-0fb17c29473b None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:45.679931 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:45.698762 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6acc9b-1106-450e-9723-c700f3e3a06b None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:45.711401 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71001466-cc6f-4d65-b406-0fb17c29473b None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:45.741676 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541cbb6-2e00-4916-903e-fee36147973f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:45.742313 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541cbb6-2e00-4916-903e-fee36147973f None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:45.742744 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541cbb6-2e00-4916-903e-fee36147973f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:45.742934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541cbb6-2e00-4916-903e-fee36147973f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:45.752825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e737c41-2a5c-4272-acdd-ac9c8aa65fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:45.753465 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e737c41-2a5c-4272-acdd-ac9c8aa65fc6 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:45.753745 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e737c41-2a5c-4272-acdd-ac9c8aa65fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:45.754022 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e737c41-2a5c-4272-acdd-ac9c8aa65fc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:45.754847 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541cbb6-2e00-4916-903e-fee36147973f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:45.756297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541cbb6-2e00-4916-903e-fee36147973f None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:45.764376 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:45.767434 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e737c41-2a5c-4272-acdd-ac9c8aa65fc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:45.769369 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e737c41-2a5c-4272-acdd-ac9c8aa65fc6 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:45.773128 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-9541cbb6-2e00-4916-903e-fee36147973f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:45.773128 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:45.773128 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:45.773128 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:45.773128 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:45.773128 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:45.773128 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:45.773128 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:45.773128 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:45.773128 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:45.773128 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:45.773128 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:45.773128 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:45.773128 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:45.773128 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:45.773128 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:45.774323 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:45.774323 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:45.774323 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:45.774323 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:45.774323 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:45.774323 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:45.774323 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:45.774323 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:45.774323 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:45.774323 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:45.774323 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:45.774323 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:45.774323 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:45.774323 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:45.774323 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:45.774323 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:45.774323 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:45.775713 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:45.775713 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:45.775713 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:45.775713 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 319/629] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:45.775713 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541cbb6-2e00-4916-903e-fee36147973f None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:45.792098 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-8e737c41-2a5c-4272-acdd-ac9c8aa65fc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:45.792098 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:45.792098 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:45.792098 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:45.792098 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:45.792098 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:45.792098 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:45.792098 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:45.792098 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:45.792098 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:45.792098 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:45.792098 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:45.792098 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:45.792098 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:45.792098 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:45.792098 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:45.793296 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:45.793296 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:45.793296 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:45.793296 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:45.793296 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:45.793296 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:45.793296 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:45.793296 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:45.793296 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:45.793296 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:45.793296 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:45.793296 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:45.793296 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:45.793296 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:45.793296 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:45.793296 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:45.793296 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:45.794705 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:45.794705 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:45.794705 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:45.794705 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 311/630] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:45.794705 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e737c41-2a5c-4272-acdd-ac9c8aa65fc6 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:45.894204 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541cbb6-2e00-4916-903e-fee36147973f None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:45.913184 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e737c41-2a5c-4272-acdd-ac9c8aa65fc6 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:45.932300 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc8afc-9295-450e-b43a-62626b11718f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:45.932829 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc8afc-9295-450e-b43a-62626b11718f None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:45.933109 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc8afc-9295-450e-b43a-62626b11718f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:45.933381 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc8afc-9295-450e-b43a-62626b11718f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:45.934109 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc8afc-9295-450e-b43a-62626b11718f None admin] RBAC: Adding query filter params (role.id=45922c768b6541549cc7b4aa2d49b0ac, scope.project.id=2cd599a81e8043bebfca960673e63bbc, user.id=4e2b26fb30024905986a99000564b475) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:45.934411 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc8afc-9295-450e-b43a-62626b11718f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:45.935881 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc8afc-9295-450e-b43a-62626b11718f None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:45.942893 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 320/631] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:04:45 2022] GET /identity/v3/role_assignments?user.id=4e2b26fb30024905986a99000564b475&scope.project.id=2cd599a81e8043bebfca960673e63bbc&role.id=45922c768b6541549cc7b4aa2d49b0ac => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:45.943730 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc8afc-9295-450e-b43a-62626b11718f None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:45.950522 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:45.962182 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7668a9-5ce2-4e1d-af6c-ea31b84db2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:45.962793 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7668a9-5ce2-4e1d-af6c-ea31b84db2f5 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:45.963166 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7668a9-5ce2-4e1d-af6c-ea31b84db2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:45.963448 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7668a9-5ce2-4e1d-af6c-ea31b84db2f5 None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:45.964134 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7668a9-5ce2-4e1d-af6c-ea31b84db2f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:45.964442 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7668a9-5ce2-4e1d-af6c-ea31b84db2f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:45.965910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7668a9-5ce2-4e1d-af6c-ea31b84db2f5 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:45.985308 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 312/632] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:45.985308 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06df1a-88b7-4edb-93a8-ffa3a61b5fa9 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:45.985308 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06df1a-88b7-4edb-93a8-ffa3a61b5fa9 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:45.985308 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06df1a-88b7-4edb-93a8-ffa3a61b5fa9 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:45.985308 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 313/633] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:45.987617 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06df1a-88b7-4edb-93a8-ffa3a61b5fa9 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:46.061898 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:46.088399 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc8afc-9295-450e-b43a-62626b11718f None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:46.122639 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06df1a-88b7-4edb-93a8-ffa3a61b5fa9 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:46.130857 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5ee2f-c8ec-4f3a-8331-8d31743a7a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:46.132229 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5ee2f-c8ec-4f3a-8331-8d31743a7a14 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:46.132499 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5ee2f-c8ec-4f3a-8331-8d31743a7a14 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:46.132775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5ee2f-c8ec-4f3a-8331-8d31743a7a14 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:46.133459 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5ee2f-c8ec-4f3a-8331-8d31743a7a14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:46.134289 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5ee2f-c8ec-4f3a-8331-8d31743a7a14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:46.136185 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5ee2f-c8ec-4f3a-8331-8d31743a7a14 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:46.150032 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 321/634] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:46.153028 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fd66d-ee11-43ee-9e93-8f85f7691ade None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:46.153627 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fd66d-ee11-43ee-9e93-8f85f7691ade None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:46.154215 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fd66d-ee11-43ee-9e93-8f85f7691ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:46.165836 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfb82a-97d1-4dcc-a446-9fdd88092760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:46.166850 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfb82a-97d1-4dcc-a446-9fdd88092760 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:46.167340 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfb82a-97d1-4dcc-a446-9fdd88092760 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:46.167791 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfb82a-97d1-4dcc-a446-9fdd88092760 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:46.177388 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfb82a-97d1-4dcc-a446-9fdd88092760 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:46.178254 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-cf7fd66d-ee11-43ee-9e93-8f85f7691ade None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:46.179259 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfb82a-97d1-4dcc-a446-9fdd88092760 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:46.179550 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-cf7fd66d-ee11-43ee-9e93-8f85f7691ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:46.197021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-4abfb82a-97d1-4dcc-a446-9fdd88092760 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:46.197021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:46.197021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:46.197021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:46.197021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:46.197021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:46.197021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:46.197021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:46.197021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:46.197021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:46.197021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:46.197021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:46.197021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:04:46.197021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:04:46.197021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:04:46.197975 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:04:46.197975 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:46.197975 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:46.197975 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:46.197975 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:46.197975 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:46.197975 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:46.197975 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:46.197975 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:46.197975 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:46.197975 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:46.197975 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:46.197975 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:46.197975 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:46.197975 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:46.197975 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:46.197975 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:46.199460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:04:46.199460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:04:46.199460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:04:46.199460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:04:46.199460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:04:46.199460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:04:46.199460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:46.199460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:46.199460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 314/635] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:46.199460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfb82a-97d1-4dcc-a446-9fdd88092760 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:46.257842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:46.272462 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 322/636] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:46.273205 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fd66d-ee11-43ee-9e93-8f85f7691ade None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:46.326353 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfb82a-97d1-4dcc-a446-9fdd88092760 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:46.342858 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:46.369172 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bfcaf-ad15-4f11-82e4-ec3de6898f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:46.370119 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bfcaf-ad15-4f11-82e4-ec3de6898f46 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:46.370577 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bfcaf-ad15-4f11-82e4-ec3de6898f46 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:46.371155 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bfcaf-ad15-4f11-82e4-ec3de6898f46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:46.379672 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bfcaf-ad15-4f11-82e4-ec3de6898f46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:46.381485 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bfcaf-ad15-4f11-82e4-ec3de6898f46 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:46.396597 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-203bfcaf-ad15-4f11-82e4-ec3de6898f46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:46.396597 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:46.396597 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:46.396597 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:46.396597 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:46.396597 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:46.396597 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:46.396597 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:46.396597 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:46.396597 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:46.396597 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:46.396597 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:46.396597 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:04:46.396597 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:04:46.396597 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:04:46.397557 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:04:46.397557 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:46.397557 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:46.397557 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:46.397557 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:46.397557 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:46.397557 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:46.397557 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:46.397557 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:46.397557 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:46.397557 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:46.397557 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:46.397557 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:46.397557 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:46.397557 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:46.397557 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:46.397557 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:46.398424 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:04:46.398424 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:04:46.398424 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:04:46.398424 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:04:46.398424 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:04:46.398424 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:04:46.398424 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:46.398424 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:46.405862 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fd66d-ee11-43ee-9e93-8f85f7691ade None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:46.406472 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 315/637] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:46.409587 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bfcaf-ad15-4f11-82e4-ec3de6898f46 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:46.444897 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4c83f-a7e0-4faf-86ef-d4064343e6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:46.445530 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4c83f-a7e0-4faf-86ef-d4064343e6a2 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:46.445777 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4c83f-a7e0-4faf-86ef-d4064343e6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:46.446045 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4c83f-a7e0-4faf-86ef-d4064343e6a2 None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:46.446768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4c83f-a7e0-4faf-86ef-d4064343e6a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:46.447357 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4c83f-a7e0-4faf-86ef-d4064343e6a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:46.448492 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4c83f-a7e0-4faf-86ef-d4064343e6a2 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:46.462738 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 323/638] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Sep 13 12:04:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:46.469257 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4c83f-a7e0-4faf-86ef-d4064343e6a2 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:46.545900 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:46.547042 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bfcaf-ad15-4f11-82e4-ec3de6898f46 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:46.590058 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd284e6a-a70b-44c3-b4f0-817eb5080d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:46.591235 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd284e6a-a70b-44c3-b4f0-817eb5080d9d None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:46.591780 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd284e6a-a70b-44c3-b4f0-817eb5080d9d None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:46.592319 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd284e6a-a70b-44c3-b4f0-817eb5080d9d None admin] PATH_INFO: `/v3/projects` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:46.593280 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd284e6a-a70b-44c3-b4f0-817eb5080d9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:46.593787 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd284e6a-a70b-44c3-b4f0-817eb5080d9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:46.596317 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd284e6a-a70b-44c3-b4f0-817eb5080d9d None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:46.610254 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 316/639] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Sep 13 12:04:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:46.618692 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd284e6a-a70b-44c3-b4f0-817eb5080d9d None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:46.619314 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4c83f-a7e0-4faf-86ef-d4064343e6a2 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:46.656212 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:46.675493 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bb315-a457-48ca-9b2a-a37a4ed042ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:46.676211 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bb315-a457-48ca-9b2a-a37a4ed042ff None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:46.676500 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bb315-a457-48ca-9b2a-a37a4ed042ff None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:46.676767 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bb315-a457-48ca-9b2a-a37a4ed042ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:46.677566 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bb315-a457-48ca-9b2a-a37a4ed042ff None admin] RBAC: Adding query filter params (role.id=45922c768b6541549cc7b4aa2d49b0ac, scope.project.id=2cd599a81e8043bebfca960673e63bbc, user.id=2e24fc5713164917ba1368ff461e9629) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:46.677880 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bb315-a457-48ca-9b2a-a37a4ed042ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:46.679382 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bb315-a457-48ca-9b2a-a37a4ed042ff None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:46.694656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 324/640] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:04:46 2022] GET /identity/v3/role_assignments?user.id=2e24fc5713164917ba1368ff461e9629&scope.project.id=2cd599a81e8043bebfca960673e63bbc&role.id=45922c768b6541549cc7b4aa2d49b0ac => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:46.694656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bb315-a457-48ca-9b2a-a37a4ed042ff None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:46.772602 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd284e6a-a70b-44c3-b4f0-817eb5080d9d None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:46.827912 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bb315-a457-48ca-9b2a-a37a4ed042ff None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:46.837151 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a149bd-c9a4-46f9-a59c-d9d3a6bcc0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:46.837832 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a149bd-c9a4-46f9-a59c-d9d3a6bcc0eb None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:46.838108 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a149bd-c9a4-46f9-a59c-d9d3a6bcc0eb None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:46.838382 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a149bd-c9a4-46f9-a59c-d9d3a6bcc0eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:46.839156 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a149bd-c9a4-46f9-a59c-d9d3a6bcc0eb None admin] RBAC: Adding query filter params (role.id=45922c768b6541549cc7b4aa2d49b0ac, scope.project.id=2cd599a81e8043bebfca960673e63bbc, user.id=06cb1e39f474441495bc09988786a84a) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:46.840230 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a149bd-c9a4-46f9-a59c-d9d3a6bcc0eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:46.841730 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a149bd-c9a4-46f9-a59c-d9d3a6bcc0eb None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:46.851681 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:46.852908 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 317/641] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:04:46 2022] GET /identity/v3/role_assignments?user.id=06cb1e39f474441495bc09988786a84a&scope.project.id=2cd599a81e8043bebfca960673e63bbc&role.id=45922c768b6541549cc7b4aa2d49b0ac => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:46.877901 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937631c-d435-4bfb-8708-5bf50b9649d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:46.878647 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937631c-d435-4bfb-8708-5bf50b9649d5 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:46.878970 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937631c-d435-4bfb-8708-5bf50b9649d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:46.879245 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937631c-d435-4bfb-8708-5bf50b9649d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:46.894222 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937631c-d435-4bfb-8708-5bf50b9649d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:46.899842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-c937631c-d435-4bfb-8708-5bf50b9649d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:46.899842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:46.899842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:46.899842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:46.899842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:46.899842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:46.899842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:46.899842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:46.899842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:46.899842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:46.899842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:46.899842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:46.899842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:46.899842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:46.899842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:46.899842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:46.900936 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:46.900936 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:46.900936 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:46.900936 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:46.900936 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:46.900936 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:46.900936 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:46.900936 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:46.900936 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:46.900936 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:46.900936 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:46.900936 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:46.900936 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:46.900936 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:46.900936 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:46.900936 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:46.902094 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:46.902094 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:46.902094 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:46.902094 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:46.902094 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:46.902094 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:46.902094 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:46.902094 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:46.902094 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:46.902094 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:46.902094 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:46.902094 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:46.902094 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 325/642] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Sep 13 12:04:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:46.908620 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a149bd-c9a4-46f9-a59c-d9d3a6bcc0eb None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:47.031887 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:47.037131 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a149bd-c9a4-46f9-a59c-d9d3a6bcc0eb None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:47.101549 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4800399-a030-4fec-a0a4-d1d0df55a2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:47.102162 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4800399-a030-4fec-a0a4-d1d0df55a2d3 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:47.102440 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4800399-a030-4fec-a0a4-d1d0df55a2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:47.102743 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4800399-a030-4fec-a0a4-d1d0df55a2d3 None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:47.103424 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4800399-a030-4fec-a0a4-d1d0df55a2d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:47.103728 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4800399-a030-4fec-a0a4-d1d0df55a2d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:47.105172 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4800399-a030-4fec-a0a4-d1d0df55a2d3 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:47.118692 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 318/643] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:47.124877 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937631c-d435-4bfb-8708-5bf50b9649d5 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:47.242203 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937631c-d435-4bfb-8708-5bf50b9649d5 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:47.280016 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3580a8-5503-4d2a-a4ee-866f7a45b553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:47.281052 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3580a8-5503-4d2a-a4ee-866f7a45b553 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:47.281612 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3580a8-5503-4d2a-a4ee-866f7a45b553 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:47.282792 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3580a8-5503-4d2a-a4ee-866f7a45b553 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:47.295498 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3580a8-5503-4d2a-a4ee-866f7a45b553 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:47.297409 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3580a8-5503-4d2a-a4ee-866f7a45b553 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:47.313469 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-da3580a8-5503-4d2a-a4ee-866f7a45b553 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:47.313469 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:47.313469 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:47.313469 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:47.313469 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:47.313469 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:47.313469 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:47.313469 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:47.313469 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:47.313469 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:47.313469 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:47.313469 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:47.313469 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:47.313469 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:47.313469 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:47.313469 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:47.314521 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:47.314521 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:47.314521 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:47.314521 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:47.314521 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:47.314521 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:47.314521 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:47.314521 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:47.314521 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:47.314521 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:47.314521 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:47.314521 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:47.314521 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:47.314521 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:47.314521 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:47.314521 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:47.314521 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:47.315459 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:47.315459 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:47.315459 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:47.317607 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 326/644] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:47.323566 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4800399-a030-4fec-a0a4-d1d0df55a2d3 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:47.439378 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4800399-a030-4fec-a0a4-d1d0df55a2d3 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:47.477947 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b948155-935e-487a-a4e0-470013c8df0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:47.479084 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b948155-935e-487a-a4e0-470013c8df0b None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:47.479589 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b948155-935e-487a-a4e0-470013c8df0b None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:47.480067 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b948155-935e-487a-a4e0-470013c8df0b None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:47.480930 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b948155-935e-487a-a4e0-470013c8df0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:47.481439 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b948155-935e-487a-a4e0-470013c8df0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:47.483064 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b948155-935e-487a-a4e0-470013c8df0b None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:47.497251 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 319/645] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:47.503861 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3580a8-5503-4d2a-a4ee-866f7a45b553 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:47.536762 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:47.642163 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3580a8-5503-4d2a-a4ee-866f7a45b553 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:47.683695 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881804d-106f-4468-9ed4-b9468d7bea6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:47.684552 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881804d-106f-4468-9ed4-b9468d7bea6c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:47.684936 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881804d-106f-4468-9ed4-b9468d7bea6c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:47.685328 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881804d-106f-4468-9ed4-b9468d7bea6c None admin] PATH_INFO: `/v3/users/nova` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:47.697572 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881804d-106f-4468-9ed4-b9468d7bea6c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:47.699063 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881804d-106f-4468-9ed4-b9468d7bea6c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:47.711582 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-1881804d-106f-4468-9ed4-b9468d7bea6c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:04:47.711582 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:47.711582 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:47.711582 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:47.711582 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:47.711582 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:47.711582 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:47.711582 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:47.711582 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:47.711582 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:47.711582 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:47.711582 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:47.711582 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:04:47.711582 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:04:47.711582 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:04:47.711582 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:04:47.712592 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:47.712592 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:47.712592 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:04:47.712592 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:47.712592 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:04:47.712592 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:47.712592 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:47.712592 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:47.712592 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:47.712592 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:47.712592 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:47.712592 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:47.712592 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:47.712592 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:47.712592 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:47.712592 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:47.712592 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:47.712592 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:47.713548 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:47.713548 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:47.713548 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:04:47.713548 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:04:47.713548 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:04:47.713548 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:04:47.713548 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:04:47.713548 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:04:47.713548 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:04:47.713548 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:47.713548 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 327/646] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Sep 13 12:04:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:04:47.721203 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b948155-935e-487a-a4e0-470013c8df0b None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:47.743485 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:47.841805 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b948155-935e-487a-a4e0-470013c8df0b None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:47.880129 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6574ec-7140-4d7b-a661-727d599c4ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:47.881170 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6574ec-7140-4d7b-a661-727d599c4ac4 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:47.881672 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6574ec-7140-4d7b-a661-727d599c4ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:47.882209 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6574ec-7140-4d7b-a661-727d599c4ac4 None admin] PATH_INFO: `/v3/users` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:47.883177 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6574ec-7140-4d7b-a661-727d599c4ac4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:47.883690 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6574ec-7140-4d7b-a661-727d599c4ac4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:47.885321 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6574ec-7140-4d7b-a661-727d599c4ac4 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:47.906488 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 320/647] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Sep 13 12:04:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:47.913326 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881804d-106f-4468-9ed4-b9468d7bea6c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:48.140854 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:48.156387 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881804d-106f-4468-9ed4-b9468d7bea6c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:48.196115 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03843a17-34df-465f-9dc8-78ab8c68be8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:48.196721 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03843a17-34df-465f-9dc8-78ab8c68be8c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:48.196995 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03843a17-34df-465f-9dc8-78ab8c68be8c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:48.197266 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03843a17-34df-465f-9dc8-78ab8c68be8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:48.275366 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03843a17-34df-465f-9dc8-78ab8c68be8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:48.276815 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03843a17-34df-465f-9dc8-78ab8c68be8c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:48.368527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:48.382415 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 328/648] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 12:04:48.387841 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6574ec-7140-4d7b-a661-727d599c4ac4 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:48.476338 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:48.502220 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6574ec-7140-4d7b-a661-727d599c4ac4 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:48.539802 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e53f6-2ec6-43fe-896d-e41af0b08e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:48.541079 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e53f6-2ec6-43fe-896d-e41af0b08e8f None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:48.541559 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e53f6-2ec6-43fe-896d-e41af0b08e8f None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:48.542148 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e53f6-2ec6-43fe-896d-e41af0b08e8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:48.553361 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e53f6-2ec6-43fe-896d-e41af0b08e8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:48.555262 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e53f6-2ec6-43fe-896d-e41af0b08e8f None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:48.571247 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-b64e53f6-2ec6-43fe-896d-e41af0b08e8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:48.571247 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:48.571247 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:48.571247 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:48.571247 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:48.571247 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:48.571247 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:48.571247 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:48.571247 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:48.571247 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:48.571247 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:48.571247 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:48.571247 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:48.571247 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:48.571247 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:48.571247 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:48.572269 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:48.572269 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:48.572269 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:48.572269 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:48.572269 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:48.572269 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:48.572269 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:48.572269 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:48.572269 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:48.572269 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:48.572269 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:48.572269 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:48.572269 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:48.572269 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:48.572269 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:48.572269 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:48.572269 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:48.573194 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:48.573194 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:48.573194 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:48.573364 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91b125-85b9-4f3f-97bd-1609a236f269 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:48.573563 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91b125-85b9-4f3f-97bd-1609a236f269 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:48.573838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91b125-85b9-4f3f-97bd-1609a236f269 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:48.575265 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 321/649] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:04:48.580351 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 329/650] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:04:48.583777 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e53f6-2ec6-43fe-896d-e41af0b08e8f None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:48.584805 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848ff2a-956f-4426-90e7-420cc7145fa9 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:48.585075 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848ff2a-956f-4426-90e7-420cc7145fa9 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:48.585353 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848ff2a-956f-4426-90e7-420cc7145fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:48.606049 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-f848ff2a-956f-4426-90e7-420cc7145fa9 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:48.607284 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-f848ff2a-956f-4426-90e7-420cc7145fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:48.686714 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 330/651] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:48.698021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e53f6-2ec6-43fe-896d-e41af0b08e8f None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:48.727527 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:48.735989 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44426d-4280-4ec0-ab6f-e07fe6b3e21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:48.736883 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44426d-4280-4ec0-ab6f-e07fe6b3e21a None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:48.737371 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44426d-4280-4ec0-ab6f-e07fe6b3e21a None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:48.737943 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44426d-4280-4ec0-ab6f-e07fe6b3e21a None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:48.738828 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44426d-4280-4ec0-ab6f-e07fe6b3e21a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:48.739337 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44426d-4280-4ec0-ab6f-e07fe6b3e21a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:48.740903 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44426d-4280-4ec0-ab6f-e07fe6b3e21a None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:48.754117 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 322/652] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:48.759857 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848ff2a-956f-4426-90e7-420cc7145fa9 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:48.864419 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848ff2a-956f-4426-90e7-420cc7145fa9 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:48.885099 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:48.905897 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876200f-5bdf-41bf-8b69-d90fcf7c531f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:48.906556 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876200f-5bdf-41bf-8b69-d90fcf7c531f None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:48.906867 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876200f-5bdf-41bf-8b69-d90fcf7c531f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:48.907716 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876200f-5bdf-41bf-8b69-d90fcf7c531f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:48.915904 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876200f-5bdf-41bf-8b69-d90fcf7c531f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:48.917357 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876200f-5bdf-41bf-8b69-d90fcf7c531f None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:48.929231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-a876200f-5bdf-41bf-8b69-d90fcf7c531f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:48.929231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:48.929231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:48.929231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:48.929231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:48.929231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:48.929231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:48.929231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:48.929231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:48.929231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:48.929231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:48.929231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:48.929231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:04:48.929231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:04:48.929231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:04:48.930180 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:04:48.930180 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:48.930180 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:48.930180 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:48.930180 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:48.930180 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:48.930180 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:48.930180 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:48.930180 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:48.930180 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:48.930180 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:48.930180 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:48.930180 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:48.930180 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:48.930180 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:48.930180 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:48.930180 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:48.931112 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:04:48.931112 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:04:48.931112 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:04:48.931112 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:04:48.931112 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:04:48.931112 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:04:48.931112 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:48.931112 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:48.931112 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 331/653] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:48.937756 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44426d-4280-4ec0-ab6f-e07fe6b3e21a None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:49.046546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44426d-4280-4ec0-ab6f-e07fe6b3e21a None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:49.084688 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2adca-8b76-4010-958b-49aede31d2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:49.085707 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2adca-8b76-4010-958b-49aede31d2a0 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:49.086199 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2adca-8b76-4010-958b-49aede31d2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:49.086743 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2adca-8b76-4010-958b-49aede31d2a0 None admin] PATH_INFO: `/v3/projects` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:49.087666 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2adca-8b76-4010-958b-49aede31d2a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:49.088178 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2adca-8b76-4010-958b-49aede31d2a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:49.089839 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2adca-8b76-4010-958b-49aede31d2a0 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:49.103662 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 323/654] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Sep 13 12:04:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:49.109772 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876200f-5bdf-41bf-8b69-d90fcf7c531f None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:49.147265 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2adca-8b76-4010-958b-49aede31d2a0 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:49.202542 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:49.228707 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876200f-5bdf-41bf-8b69-d90fcf7c531f None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:49.264211 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2adca-8b76-4010-958b-49aede31d2a0 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:49.268623 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75a0ef-cb32-4b1f-a7bc-c31c29cc6c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:49.268623 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75a0ef-cb32-4b1f-a7bc-c31c29cc6c8f None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:49.268899 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75a0ef-cb32-4b1f-a7bc-c31c29cc6c8f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:49.269265 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75a0ef-cb32-4b1f-a7bc-c31c29cc6c8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:49.270063 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75a0ef-cb32-4b1f-a7bc-c31c29cc6c8f None admin] RBAC: Adding query filter params (role.id=5609ac7373ba400593bba6d811e3aa72, scope.project.id=2cd599a81e8043bebfca960673e63bbc, user.id=e740dc7330284b0bbe6a825186f0a55d) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:49.270456 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75a0ef-cb32-4b1f-a7bc-c31c29cc6c8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:49.271995 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75a0ef-cb32-4b1f-a7bc-c31c29cc6c8f None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:49.282892 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 332/655] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:04:49 2022] GET /identity/v3/role_assignments?user.id=e740dc7330284b0bbe6a825186f0a55d&scope.project.id=2cd599a81e8043bebfca960673e63bbc&role.id=5609ac7373ba400593bba6d811e3aa72 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:49.317274 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ed88d-c14f-4a89-a94b-6751d6a71ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:49.317898 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ed88d-c14f-4a89-a94b-6751d6a71ea8 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:49.318181 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ed88d-c14f-4a89-a94b-6751d6a71ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:49.318451 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ed88d-c14f-4a89-a94b-6751d6a71ea8 None admin] PATH_INFO: `/v3/services/image` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:49.319082 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ed88d-c14f-4a89-a94b-6751d6a71ea8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:49.320579 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ed88d-c14f-4a89-a94b-6751d6a71ea8 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:49.334314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-6c1ed88d-c14f-4a89-a94b-6751d6a71ea8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:04:49.334314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:49.334314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:04:49.334314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:04:49.334314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:04:49.334314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:04:49.334314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:04:49.334314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:04:49.334314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:04:49.334314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:49.334314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:04:49.334314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:49.334314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:49.334314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:49.334314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:49.334314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:49.334314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:49.335494 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:49.335494 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:49.335494 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:49.335494 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:49.335494 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:49.335494 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:49.335494 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:04:49.335494 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:04:49.335494 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:04:49.335494 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:04:49.335494 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:49.335494 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:49.335494 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:49.335494 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:49.335494 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:49.335494 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:49.336352 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:49.336352 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:49.336352 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:49.336352 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:49.336352 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:49.336352 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:49.336352 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:49.336352 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:49.336352 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:49.336352 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:49.336352 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:04:49.336352 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:04:49.336352 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:04:49.336352 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:49.336352 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 324/656] 10.222.0.15 () {56 vars in 1105 bytes} [Tue Sep 13 12:04:49 2022] GET /identity/v3/services/image => generated 86 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:04:49.339187 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb5535-f7a5-47bc-9f46-fe9cee0b2268 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:49.339473 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb5535-f7a5-47bc-9f46-fe9cee0b2268 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:49.339741 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb5535-f7a5-47bc-9f46-fe9cee0b2268 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:49.341303 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 333/657] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:04:49.347843 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ed88d-c14f-4a89-a94b-6751d6a71ea8 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:49.348027 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a7afd-8ddd-49e4-aae4-513a282d4fe4 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:49.348249 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a7afd-8ddd-49e4-aae4-513a282d4fe4 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:49.348416 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a7afd-8ddd-49e4-aae4-513a282d4fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:49.373501 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-612a7afd-8ddd-49e4-aae4-513a282d4fe4 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:49.375190 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-612a7afd-8ddd-49e4-aae4-513a282d4fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:49.423602 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:49.465443 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 334/658] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:49.474863 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ed88d-c14f-4a89-a94b-6751d6a71ea8 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:49.492323 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:49.527181 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834368a-10fe-43a6-ade0-6ae92031e014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:49.527795 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834368a-10fe-43a6-ade0-6ae92031e014 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:49.528075 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834368a-10fe-43a6-ade0-6ae92031e014 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:49.528427 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834368a-10fe-43a6-ade0-6ae92031e014 None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:49.528991 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834368a-10fe-43a6-ade0-6ae92031e014 None admin] RBAC: Adding query filter params (name=image) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:49.529296 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834368a-10fe-43a6-ade0-6ae92031e014 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:49.530767 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834368a-10fe-43a6-ade0-6ae92031e014 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:49.536076 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 325/659] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:49.544100 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a7afd-8ddd-49e4-aae4-513a282d4fe4 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:49.589824 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c73cc-0cb0-47e0-8b28-b96dafc31054 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:49.590068 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c73cc-0cb0-47e0-8b28-b96dafc31054 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:49.590354 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c73cc-0cb0-47e0-8b28-b96dafc31054 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:49.591953 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 326/660] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:49.597143 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f39f47-486a-4e52-baab-27c665be5fb6 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:49.597423 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f39f47-486a-4e52-baab-27c665be5fb6 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:49.597729 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f39f47-486a-4e52-baab-27c665be5fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:49.617214 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-96f39f47-486a-4e52-baab-27c665be5fb6 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:49.618543 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-96f39f47-486a-4e52-baab-27c665be5fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:49.657774 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a7afd-8ddd-49e4-aae4-513a282d4fe4 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:49.697307 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383696a-b1ee-4f84-8e65-d42b51d79584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:49.697930 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383696a-b1ee-4f84-8e65-d42b51d79584 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:49.698203 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383696a-b1ee-4f84-8e65-d42b51d79584 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:49.698468 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383696a-b1ee-4f84-8e65-d42b51d79584 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:49.699129 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383696a-b1ee-4f84-8e65-d42b51d79584 None admin] RBAC: Adding query filter params (type=image) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:49.699428 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383696a-b1ee-4f84-8e65-d42b51d79584 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:49.700777 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383696a-b1ee-4f84-8e65-d42b51d79584 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:49.707988 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 335/661] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:49.710747 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 327/662] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:04:49.847557 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383696a-b1ee-4f84-8e65-d42b51d79584 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:49.887676 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:49.973417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383696a-b1ee-4f84-8e65-d42b51d79584 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:50.020272 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bd32b-cae5-4a0b-93f7-bab36631bfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:50.020905 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bd32b-cae5-4a0b-93f7-bab36631bfc9 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:50.021236 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bd32b-cae5-4a0b-93f7-bab36631bfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:50.021508 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7bd32b-cae5-4a0b-93f7-bab36631bfc9 None admin] PATH_INFO: `/v3/services/network` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:50.022091 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bd32b-cae5-4a0b-93f7-bab36631bfc9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:50.023484 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7bd32b-cae5-4a0b-93f7-bab36631bfc9 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:50.035281 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-0f7bd32b-cae5-4a0b-93f7-bab36631bfc9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:04:50.035281 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:50.035281 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:04:50.035281 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:04:50.035281 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:04:50.035281 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:04:50.035281 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:04:50.035281 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:04:50.035281 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:04:50.035281 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:50.035281 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:04:50.035281 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:50.035281 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:50.035281 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:50.035281 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:50.035281 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:50.035281 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:50.036301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:50.036301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:50.036301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:50.036301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:50.036301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:50.036301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:50.036301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:04:50.036301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:04:50.036301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:04:50.036301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:04:50.036301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:50.036301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:50.036301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:50.036301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:50.036301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:50.036301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:50.037124 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:50.037124 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:50.037124 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:50.037124 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:50.037124 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:50.037124 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:50.037124 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:50.037124 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:50.037124 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:50.037124 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:50.037124 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:04:50.037124 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:04:50.037124 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:04:50.037124 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:50.037124 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 336/663] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:49 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:50.043007 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bd32b-cae5-4a0b-93f7-bab36631bfc9 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:50.043140 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f39f47-486a-4e52-baab-27c665be5fb6 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:50.160510 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f39f47-486a-4e52-baab-27c665be5fb6 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:50.171091 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:50.172772 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:50.174513 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7bd32b-cae5-4a0b-93f7-bab36631bfc9 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:50.204628 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf71689-2518-4d72-bfbc-e6a5da85e0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:50.205547 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf71689-2518-4d72-bfbc-e6a5da85e0ff None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:50.205830 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf71689-2518-4d72-bfbc-e6a5da85e0ff None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:50.206102 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf71689-2518-4d72-bfbc-e6a5da85e0ff None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:50.206786 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf71689-2518-4d72-bfbc-e6a5da85e0ff None admin] RBAC: Adding query filter params (name=network) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:50.207091 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf71689-2518-4d72-bfbc-e6a5da85e0ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:50.208468 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf71689-2518-4d72-bfbc-e6a5da85e0ff None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:50.213455 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 328/664] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Sep 13 12:04:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:50.224276 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf71689-2518-4d72-bfbc-e6a5da85e0ff None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:50.227353 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc47e4-2db8-43ea-8d00-6cf0f47671e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:50.228319 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc47e4-2db8-43ea-8d00-6cf0f47671e7 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:50.228602 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc47e4-2db8-43ea-8d00-6cf0f47671e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:50.228873 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc47e4-2db8-43ea-8d00-6cf0f47671e7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:50.229463 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc47e4-2db8-43ea-8d00-6cf0f47671e7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:50.235668 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc47e4-2db8-43ea-8d00-6cf0f47671e7 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:50.250553 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-7ccc47e4-2db8-43ea-8d00-6cf0f47671e7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:04:50.250553 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:50.250553 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:04:50.250553 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:04:50.250553 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:04:50.250553 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:04:50.250553 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:04:50.250553 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:04:50.250553 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:04:50.250553 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:50.250553 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:04:50.250553 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:50.250553 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:50.250553 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:50.250553 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:50.250553 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:50.250553 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:50.251619 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:50.251619 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:50.251619 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:50.251619 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:50.251619 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:50.251619 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:50.251619 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:04:50.251619 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:04:50.251619 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:04:50.251619 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:04:50.251619 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:50.251619 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:50.251619 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:50.251619 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:50.251619 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:50.251619 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:50.252468 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:50.252468 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:50.252468 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:50.252468 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:50.252468 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:50.252468 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:50.252468 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:50.252468 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:50.252468 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:50.252468 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:50.252468 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:04:50.252468 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:04:50.252468 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:04:50.252468 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:50.254697 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 337/665] 10.222.0.15 () {56 vars in 1129 bytes} [Tue Sep 13 12:04:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:50.258176 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc47e4-2db8-43ea-8d00-6cf0f47671e7 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:50.358879 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf71689-2518-4d72-bfbc-e6a5da85e0ff None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:50.376966 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc47e4-2db8-43ea-8d00-6cf0f47671e7 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:50.399587 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c23d2b-7d95-498a-9a84-b05b553cdab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:50.400624 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c23d2b-7d95-498a-9a84-b05b553cdab1 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:50.401193 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c23d2b-7d95-498a-9a84-b05b553cdab1 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:50.401677 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c23d2b-7d95-498a-9a84-b05b553cdab1 None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:50.402560 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c23d2b-7d95-498a-9a84-b05b553cdab1 None admin] RBAC: Adding query filter params (type=network) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:50.403104 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c23d2b-7d95-498a-9a84-b05b553cdab1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:50.404888 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c23d2b-7d95-498a-9a84-b05b553cdab1 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:50.418890 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 329/666] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Sep 13 12:04:50 2022] GET /identity/v3/services?type=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:50.424947 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08ccee-57e1-47cd-9e01-4fec07812c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:50.425759 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08ccee-57e1-47cd-9e01-4fec07812c4d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:50.425997 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08ccee-57e1-47cd-9e01-4fec07812c4d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:50.426217 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08ccee-57e1-47cd-9e01-4fec07812c4d None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:50.426994 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08ccee-57e1-47cd-9e01-4fec07812c4d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:50.427302 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08ccee-57e1-47cd-9e01-4fec07812c4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:50.428735 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08ccee-57e1-47cd-9e01-4fec07812c4d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:50.434304 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 338/667] 10.222.0.15 () {56 vars in 1124 bytes} [Tue Sep 13 12:04:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:50.440778 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c23d2b-7d95-498a-9a84-b05b553cdab1 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:50.488413 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:50.585283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c23d2b-7d95-498a-9a84-b05b553cdab1 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:50.629552 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b636612-64c6-4b59-972b-537ae884a631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:50.630570 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b636612-64c6-4b59-972b-537ae884a631 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:50.631111 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b636612-64c6-4b59-972b-537ae884a631 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:50.631575 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b636612-64c6-4b59-972b-537ae884a631 None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:50.632498 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b636612-64c6-4b59-972b-537ae884a631 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:50.632815 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b636612-64c6-4b59-972b-537ae884a631 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:50.634344 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b636612-64c6-4b59-972b-537ae884a631 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:50.640223 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 330/668] 10.222.0.15 () {56 vars in 1124 bytes} [Tue Sep 13 12:04:50 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:51.927254 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217b93b-6bf2-455b-b5e0-a52178cf0a20 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:51.928061 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217b93b-6bf2-455b-b5e0-a52178cf0a20 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:51.928061 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217b93b-6bf2-455b-b5e0-a52178cf0a20 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:51.929386 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 339/669] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:51.935572 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd33533-da00-4c69-a430-be0ea94d4bc0 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:51.936316 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd33533-da00-4c69-a430-be0ea94d4bc0 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:51.936316 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd33533-da00-4c69-a430-be0ea94d4bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:51.957157 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-3bd33533-da00-4c69-a430-be0ea94d4bc0 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:51.958380 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-3bd33533-da00-4c69-a430-be0ea94d4bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:52.033513 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 331/670] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:04:52.361230 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217b93b-6bf2-455b-b5e0-a52178cf0a20 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:52.374445 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3327e27-dd99-4d05-bba6-dbd5c1387216 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:52.374829 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3327e27-dd99-4d05-bba6-dbd5c1387216 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:52.375052 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3327e27-dd99-4d05-bba6-dbd5c1387216 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:52.376871 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 332/671] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:52.384501 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ab83c-d98c-4b5f-82c0-e8f95a7158c9 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:52.384501 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ab83c-d98c-4b5f-82c0-e8f95a7158c9 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:52.384501 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ab83c-d98c-4b5f-82c0-e8f95a7158c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:52.400663 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:52.404804 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-9a2ab83c-d98c-4b5f-82c0-e8f95a7158c9 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:52.405998 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-9a2ab83c-d98c-4b5f-82c0-e8f95a7158c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:52.435034 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:52.490395 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 333/672] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 12:04:52.500882 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217b93b-6bf2-455b-b5e0-a52178cf0a20 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:52.548240 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd71a62-8559-4b8c-b85a-816a57e28ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:52.549243 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd71a62-8559-4b8c-b85a-816a57e28ad9 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:52.549785 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd71a62-8559-4b8c-b85a-816a57e28ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:52.550260 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd71a62-8559-4b8c-b85a-816a57e28ad9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:52.564063 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd71a62-8559-4b8c-b85a-816a57e28ad9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:52.569367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-6bd71a62-8559-4b8c-b85a-816a57e28ad9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:52.569367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:52.569367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:52.569367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:52.569367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:52.569367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:52.569367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:52.569367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:52.569367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:52.569367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:52.569367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:52.569367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:52.569367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:52.569367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:52.569367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:52.569367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:52.570368 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:52.570368 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:52.570368 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:52.570368 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:52.570368 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:52.570368 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:52.570368 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:52.570368 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:52.570368 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:52.570368 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:52.570368 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:52.570368 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:52.570368 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:52.570368 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:52.570368 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:52.570368 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:52.571275 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:52.571275 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:52.571275 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:52.571275 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:52.571275 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:52.571275 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:52.571275 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:52.571275 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:52.571275 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:52.571275 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:52.571275 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:52.571275 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:52.574076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 340/673] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Sep 13 12:04:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:52.580720 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ab83c-d98c-4b5f-82c0-e8f95a7158c9 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:52.699020 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ab83c-d98c-4b5f-82c0-e8f95a7158c9 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:52.740168 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e73e4f-f21d-4446-930e-034bb664136e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:52.741139 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e73e4f-f21d-4446-930e-034bb664136e None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:52.741620 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e73e4f-f21d-4446-930e-034bb664136e None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:52.742126 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e73e4f-f21d-4446-930e-034bb664136e None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:52.743099 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e73e4f-f21d-4446-930e-034bb664136e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:52.743627 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e73e4f-f21d-4446-930e-034bb664136e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:52.745287 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e73e4f-f21d-4446-930e-034bb664136e None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:52.756221 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 334/674] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:52.762725 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd71a62-8559-4b8c-b85a-816a57e28ad9 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:52.867015 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:52.875048 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e73e4f-f21d-4446-930e-034bb664136e None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:52.882334 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd71a62-8559-4b8c-b85a-816a57e28ad9 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:52.901516 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:52.930321 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce87860-fdf7-4646-ace5-4ed1c641ca73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:52.931105 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce87860-fdf7-4646-ace5-4ed1c641ca73 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:52.931244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce87860-fdf7-4646-ace5-4ed1c641ca73 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:52.931501 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce87860-fdf7-4646-ace5-4ed1c641ca73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:52.945252 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce87860-fdf7-4646-ace5-4ed1c641ca73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:52.946946 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce87860-fdf7-4646-ace5-4ed1c641ca73 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:52.967282 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-dce87860-fdf7-4646-ace5-4ed1c641ca73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:52.967282 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:52.967282 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:52.967282 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:52.967282 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:52.967282 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:52.967282 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:52.967282 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:52.967282 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:52.967282 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:52.967282 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:52.967282 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:52.967282 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:52.967282 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:52.967282 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:52.967282 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:52.968454 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:52.968454 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:52.968454 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:52.968454 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:52.968454 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:52.968454 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:52.968454 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:52.968454 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:52.968454 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:52.968454 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:52.968454 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:52.968454 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:52.968454 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:52.968454 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:52.968454 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:52.968454 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:52.968454 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:52.969510 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:52.969510 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:52.969510 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:52.971577 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 341/675] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:52.978670 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce87860-fdf7-4646-ace5-4ed1c641ca73 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:53.014764 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e73e4f-f21d-4446-930e-034bb664136e None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:53.068267 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09f601-7cbf-4b12-a91b-3cf0f6fdf933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:53.068886 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09f601-7cbf-4b12-a91b-3cf0f6fdf933 None admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:53.069164 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09f601-7cbf-4b12-a91b-3cf0f6fdf933 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:53.069438 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09f601-7cbf-4b12-a91b-3cf0f6fdf933 None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:53.070115 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09f601-7cbf-4b12-a91b-3cf0f6fdf933 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:53.071810 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09f601-7cbf-4b12-a91b-3cf0f6fdf933 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:53.099488 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 335/676] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Sep 13 12:04:52 2022] POST /identity/v3/services => generated 242 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:04:53.123119 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce87860-fdf7-4646-ace5-4ed1c641ca73 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:53.182049 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4f0c0-3b6c-4daa-ba63-7dc27f0d6977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:53.182978 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4f0c0-3b6c-4daa-ba63-7dc27f0d6977 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:53.183515 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4f0c0-3b6c-4daa-ba63-7dc27f0d6977 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:53.183936 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4f0c0-3b6c-4daa-ba63-7dc27f0d6977 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:53.184802 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4f0c0-3b6c-4daa-ba63-7dc27f0d6977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:53.185275 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4f0c0-3b6c-4daa-ba63-7dc27f0d6977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:53.187825 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4f0c0-3b6c-4daa-ba63-7dc27f0d6977 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:53.192178 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:53.203544 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 342/677] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:53.210025 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09f601-7cbf-4b12-a91b-3cf0f6fdf933 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:53.284001 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525ec18-e28e-42e8-b4fd-706ebf96cab2 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:53.284345 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525ec18-e28e-42e8-b4fd-706ebf96cab2 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:53.284545 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525ec18-e28e-42e8-b4fd-706ebf96cab2 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:53.287346 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 343/678] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:04:53.292345 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c51433-8460-4d62-8f32-f69d50e4c94a None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:53.292689 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c51433-8460-4d62-8f32-f69d50e4c94a None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:53.293029 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c51433-8460-4d62-8f32-f69d50e4c94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:53.315521 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-a4c51433-8460-4d62-8f32-f69d50e4c94a None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:53.316747 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-a4c51433-8460-4d62-8f32-f69d50e4c94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:53.318750 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:53.345849 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09f601-7cbf-4b12-a91b-3cf0f6fdf933 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:53.395232 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc12030-b8b7-4ee8-b5a9-1e17eb7aa0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:53.395871 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc12030-b8b7-4ee8-b5a9-1e17eb7aa0e5 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:53.396150 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc12030-b8b7-4ee8-b5a9-1e17eb7aa0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:53.396420 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc12030-b8b7-4ee8-b5a9-1e17eb7aa0e5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:53.406329 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc12030-b8b7-4ee8-b5a9-1e17eb7aa0e5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:53.408869 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc12030-b8b7-4ee8-b5a9-1e17eb7aa0e5 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:53.425730 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 344/679] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:53 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:04:53.425960 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-ecc12030-b8b7-4ee8-b5a9-1e17eb7aa0e5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:04:53.425960 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:53.425960 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:53.425960 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:53.425960 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:53.425960 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:53.425960 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:53.425960 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:53.425960 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:53.425960 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:53.425960 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:53.425960 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:53.425960 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:04:53.425960 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:04:53.425960 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:04:53.425960 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:04:53.427261 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:53.427261 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:53.427261 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:04:53.427261 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:53.427261 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:04:53.427261 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:53.427261 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:53.427261 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:53.427261 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:53.427261 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:53.427261 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:53.427261 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:53.427261 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:53.427261 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:53.427261 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:53.427261 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:53.427261 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:53.427261 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:53.428283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:53.428283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:53.428283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:04:53.428283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:04:53.428283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:04:53.428283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:04:53.428283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:04:53.428283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:04:53.428283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:04:53.428283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:53.428283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 336/680] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Sep 13 12:04:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:53.431804 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c51433-8460-4d62-8f32-f69d50e4c94a None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:53.500256 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a53445-f7f2-481a-a1cd-c4611541d065 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:53.500429 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a53445-f7f2-481a-a1cd-c4611541d065 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:53.501283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a53445-f7f2-481a-a1cd-c4611541d065 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:53.503283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 337/681] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:53.509227 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a36fa6-30b3-4f17-b1f7-cc38af1a86f0 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:53.509841 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a36fa6-30b3-4f17-b1f7-cc38af1a86f0 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:53.510341 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a36fa6-30b3-4f17-b1f7-cc38af1a86f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:53.532139 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-b9a36fa6-30b3-4f17-b1f7-cc38af1a86f0 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:53.534669 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-b9a36fa6-30b3-4f17-b1f7-cc38af1a86f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:53.556897 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c51433-8460-4d62-8f32-f69d50e4c94a None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:53.598489 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:53.609721 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e41a0a-230f-4656-961a-49cde6360966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:53.611033 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e41a0a-230f-4656-961a-49cde6360966 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:53.611536 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e41a0a-230f-4656-961a-49cde6360966 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:53.611948 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e41a0a-230f-4656-961a-49cde6360966 None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:53.612938 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e41a0a-230f-4656-961a-49cde6360966 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:53.613397 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e41a0a-230f-4656-961a-49cde6360966 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:53.614996 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e41a0a-230f-4656-961a-49cde6360966 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:53.635926 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 338/682] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:53 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 12:04:53.641241 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 345/683] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Sep 13 12:04:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:53.646795 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a36fa6-30b3-4f17-b1f7-cc38af1a86f0 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:53.722508 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:53.760382 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a36fa6-30b3-4f17-b1f7-cc38af1a86f0 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:53.783865 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e41a0a-230f-4656-961a-49cde6360966 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:53.806101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9078b1e-9954-4952-a0f8-3fa548700177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:53.807542 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9078b1e-9954-4952-a0f8-3fa548700177 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:53.808035 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9078b1e-9954-4952-a0f8-3fa548700177 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:53.808759 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9078b1e-9954-4952-a0f8-3fa548700177 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:53.826194 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9078b1e-9954-4952-a0f8-3fa548700177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:53.828564 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9078b1e-9954-4952-a0f8-3fa548700177 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:53.853491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-e9078b1e-9954-4952-a0f8-3fa548700177 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:53.853491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:53.853491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:53.853491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:53.853491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:53.853491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:53.853491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:53.853491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:53.853491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:53.853491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:53.853491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:53.853491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:53.853491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:53.853491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:53.853491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:53.853491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:53.854524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:53.854524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:53.854524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:53.854524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:53.854524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:53.854524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:53.854524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:53.854524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:53.854524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:53.854524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:53.854524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:53.854524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:53.854524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:53.854524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:53.854524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:53.854524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:53.854524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:53.855423 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:53.855423 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:53.855423 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:53.856541 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 339/684] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:04:53.862677 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9078b1e-9954-4952-a0f8-3fa548700177 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:53.921678 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e41a0a-230f-4656-961a-49cde6360966 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:53.968281 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d1cfc-18eb-4154-aa59-f7c532ef7673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:53.970153 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d1cfc-18eb-4154-aa59-f7c532ef7673 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:53.970897 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d1cfc-18eb-4154-aa59-f7c532ef7673 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:53.972136 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d1cfc-18eb-4154-aa59-f7c532ef7673 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:53.973113 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d1cfc-18eb-4154-aa59-f7c532ef7673 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:53.974910 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d1cfc-18eb-4154-aa59-f7c532ef7673 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:53.985394 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9078b1e-9954-4952-a0f8-3fa548700177 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:53.996605 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 346/685] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Sep 13 12:04:53 2022] POST /identity/v3/services => generated 240 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:04:53.998114 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d1cfc-18eb-4154-aa59-f7c532ef7673 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:54.014601 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:54.037334 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee461ff2-9519-4c0f-a88e-beb85ef9b808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:54.038009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee461ff2-9519-4c0f-a88e-beb85ef9b808 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:54.038292 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee461ff2-9519-4c0f-a88e-beb85ef9b808 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:54.038573 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee461ff2-9519-4c0f-a88e-beb85ef9b808 None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:54.039366 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee461ff2-9519-4c0f-a88e-beb85ef9b808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:54.039676 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee461ff2-9519-4c0f-a88e-beb85ef9b808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:54.041558 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee461ff2-9519-4c0f-a88e-beb85ef9b808 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:54.060528 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 340/686] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:54.062055 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee461ff2-9519-4c0f-a88e-beb85ef9b808 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:54.082496 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:54.155972 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d1cfc-18eb-4154-aa59-f7c532ef7673 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:54.212739 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa62b4-d217-4894-bba8-e9303bcceda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:54.214507 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa62b4-d217-4894-bba8-e9303bcceda6 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:54.215014 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa62b4-d217-4894-bba8-e9303bcceda6 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:54.215480 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa62b4-d217-4894-bba8-e9303bcceda6 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:54.216358 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa62b4-d217-4894-bba8-e9303bcceda6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:54.216570 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee461ff2-9519-4c0f-a88e-beb85ef9b808 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:54.218467 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa62b4-d217-4894-bba8-e9303bcceda6 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:54.240072 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 347/687] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Sep 13 12:04:53 2022] POST /identity/v3/services => generated 251 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:04:54.278548 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962771f-2f25-4b8c-b29f-1f3a601b796c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:54.279635 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962771f-2f25-4b8c-b29f-1f3a601b796c None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:54.280195 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962771f-2f25-4b8c-b29f-1f3a601b796c None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:54.280687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962771f-2f25-4b8c-b29f-1f3a601b796c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:54.290428 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962771f-2f25-4b8c-b29f-1f3a601b796c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:54.292654 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962771f-2f25-4b8c-b29f-1f3a601b796c None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:54.307348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-6962771f-2f25-4b8c-b29f-1f3a601b796c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:54.307348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:54.307348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:54.307348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:54.307348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:54.307348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:54.307348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:54.307348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:54.307348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:54.307348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:54.307348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:54.307348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:54.307348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:04:54.307348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:04:54.307348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:04:54.308351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:04:54.308351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:54.308351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:54.308351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:54.308351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:54.308351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:54.308351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:54.308351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:54.308351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:54.308351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:54.308351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:54.308351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:54.308351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:54.308351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:54.308351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:54.308351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:54.308351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:54.309245 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:04:54.309245 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:04:54.309245 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:04:54.309245 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:04:54.309245 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:04:54.309245 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:04:54.309245 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:04:54.309245 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:54.311991 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 341/688] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:54.319001 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa62b4-d217-4894-bba8-e9303bcceda6 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:54.440667 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa62b4-d217-4894-bba8-e9303bcceda6 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:54.443786 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:54.482260 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957ed05-74cb-4001-8340-6adac1c02318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:54.483402 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957ed05-74cb-4001-8340-6adac1c02318 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:54.483886 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957ed05-74cb-4001-8340-6adac1c02318 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:54.484390 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957ed05-74cb-4001-8340-6adac1c02318 None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:54.485551 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957ed05-74cb-4001-8340-6adac1c02318 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:54.486091 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957ed05-74cb-4001-8340-6adac1c02318 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:54.487878 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957ed05-74cb-4001-8340-6adac1c02318 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:54.504645 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 348/689] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Sep 13 12:04:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:54.511364 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962771f-2f25-4b8c-b29f-1f3a601b796c None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:54.555704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:54.638266 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962771f-2f25-4b8c-b29f-1f3a601b796c None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:54.677536 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106db18-c3fa-4b3f-be33-16a14a11ae5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:54.678351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106db18-c3fa-4b3f-be33-16a14a11ae5e None admin] REQUEST_METHOD: `PUT` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:54.678772 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106db18-c3fa-4b3f-be33-16a14a11ae5e None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:54.679153 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106db18-c3fa-4b3f-be33-16a14a11ae5e None admin] PATH_INFO: `/v3/projects/2cd599a81e8043bebfca960673e63bbc/users/e740dc7330284b0bbe6a825186f0a55d/roles/5609ac7373ba400593bba6d811e3aa72` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:54.681205 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106db18-c3fa-4b3f-be33-16a14a11ae5e None admin] RBAC: Authorizing `identity:create_grant(project_id=2cd599a81e8043bebfca960673e63bbc, user_id=e740dc7330284b0bbe6a825186f0a55d, role_id=5609ac7373ba400593bba6d811e3aa72)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:54.682862 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106db18-c3fa-4b3f-be33-16a14a11ae5e None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:54.701310 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 342/690] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Sep 13 12:04:54 2022] PUT /identity/v3/projects/2cd599a81e8043bebfca960673e63bbc/users/e740dc7330284b0bbe6a825186f0a55d/roles/5609ac7373ba400593bba6d811e3aa72 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:04:55.788435 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeff18-c588-42b1-a2e1-5d0260e6bd3d None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:55.789005 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeff18-c588-42b1-a2e1-5d0260e6bd3d None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:55.789005 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeff18-c588-42b1-a2e1-5d0260e6bd3d None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:55.790465 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 349/691] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:55.796403 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1125ab-9f36-4173-81f0-0561e38e5f7b None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:55.797231 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1125ab-9f36-4173-81f0-0561e38e5f7b None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:55.797779 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1125ab-9f36-4173-81f0-0561e38e5f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:55.817252 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-5d1125ab-9f36-4173-81f0-0561e38e5f7b None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:55.818881 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-5d1125ab-9f36-4173-81f0-0561e38e5f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:55.894819 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 343/692] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:55 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:04:56.244325 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befeff18-c588-42b1-a2e1-5d0260e6bd3d None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:56.361618 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befeff18-c588-42b1-a2e1-5d0260e6bd3d None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:56.398448 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74653a11-9ae8-4bdf-b684-105f4e9e31cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:56.399480 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74653a11-9ae8-4bdf-b684-105f4e9e31cb None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:56.399958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74653a11-9ae8-4bdf-b684-105f4e9e31cb None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:56.400425 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74653a11-9ae8-4bdf-b684-105f4e9e31cb None admin] PATH_INFO: `/v3/services/image` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:56.401321 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74653a11-9ae8-4bdf-b684-105f4e9e31cb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:56.402985 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74653a11-9ae8-4bdf-b684-105f4e9e31cb None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:56.414532 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-74653a11-9ae8-4bdf-b684-105f4e9e31cb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:04:56.414532 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:56.414532 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:04:56.414532 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:04:56.414532 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:04:56.414532 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:04:56.414532 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:04:56.414532 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:04:56.414532 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:04:56.414532 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:56.414532 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:04:56.414532 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:56.414532 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:56.414532 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:56.414532 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:56.414532 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:56.414532 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:56.416150 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:56.416150 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:56.416150 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:56.416150 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:56.416150 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:56.416150 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:56.416150 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:04:56.416150 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:04:56.416150 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:04:56.416150 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:04:56.416150 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:56.416150 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:56.416150 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:56.416150 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:56.416150 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:56.416150 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:56.417113 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:56.417113 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:56.417113 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:56.417113 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:56.417113 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:56.417113 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:56.417113 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:56.417113 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:56.417113 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:56.417113 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:56.417113 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:04:56.417113 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:04:56.417113 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:04:56.417113 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:56.420858 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 350/693] 10.222.0.15 () {56 vars in 1105 bytes} [Tue Sep 13 12:04:56 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:56.428585 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1125ab-9f36-4173-81f0-0561e38e5f7b None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:56.456822 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:56.541200 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1125ab-9f36-4173-81f0-0561e38e5f7b None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:56.587717 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa0552-665d-49af-ad5f-9bc1fbd039fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:56.588332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa0552-665d-49af-ad5f-9bc1fbd039fb None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:56.588610 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa0552-665d-49af-ad5f-9bc1fbd039fb None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:56.588877 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa0552-665d-49af-ad5f-9bc1fbd039fb None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:56.589508 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa0552-665d-49af-ad5f-9bc1fbd039fb None admin] RBAC: Adding query filter params (name=image) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:56.589810 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa0552-665d-49af-ad5f-9bc1fbd039fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:56.591261 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa0552-665d-49af-ad5f-9bc1fbd039fb None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:56.597546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 344/694] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:56.603087 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74653a11-9ae8-4bdf-b684-105f4e9e31cb None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:56.647083 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:56.719003 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba609802-3124-42b1-95c5-16cb3dd20733 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:56.719380 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba609802-3124-42b1-95c5-16cb3dd20733 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:56.719708 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba609802-3124-42b1-95c5-16cb3dd20733 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:56.721425 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 345/695] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:56.727039 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a81d93-aa47-440c-be3d-eb9ec2671e5c None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:56.727322 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a81d93-aa47-440c-be3d-eb9ec2671e5c None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:56.727587 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a81d93-aa47-440c-be3d-eb9ec2671e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:56.735218 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74653a11-9ae8-4bdf-b684-105f4e9e31cb None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:56.746484 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-04a81d93-aa47-440c-be3d-eb9ec2671e5c None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:56.747725 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-04a81d93-aa47-440c-be3d-eb9ec2671e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:56.774817 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9212d0e-38b8-4afb-ab63-c5f473e283e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:56.775529 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9212d0e-38b8-4afb-ab63-c5f473e283e3 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:56.775810 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9212d0e-38b8-4afb-ab63-c5f473e283e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:56.776080 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9212d0e-38b8-4afb-ab63-c5f473e283e3 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:56.776720 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9212d0e-38b8-4afb-ab63-c5f473e283e3 None admin] RBAC: Adding query filter params (type=image) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:56.777022 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9212d0e-38b8-4afb-ab63-c5f473e283e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:56.778646 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9212d0e-38b8-4afb-ab63-c5f473e283e3 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:56.784743 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 351/696] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:56.790511 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9212d0e-38b8-4afb-ab63-c5f473e283e3 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:56.839040 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 346/697] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:56 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:04:56.904911 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:56.908707 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296102e7-adde-4942-96be-7bdc28659105 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:56.909616 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296102e7-adde-4942-96be-7bdc28659105 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:56.909919 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296102e7-adde-4942-96be-7bdc28659105 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:56.911895 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 347/698] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:04:56.917786 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5fb89-285f-40d9-a374-ce667b56807d None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:56.918103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5fb89-285f-40d9-a374-ce667b56807d None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:56.918341 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5fb89-285f-40d9-a374-ce667b56807d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:56.919568 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9212d0e-38b8-4afb-ab63-c5f473e283e3 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:56.940286 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-56a5fb89-285f-40d9-a374-ce667b56807d None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:56.941655 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-56a5fb89-285f-40d9-a374-ce667b56807d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:56.959450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:56.962308 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2d74a-8673-487c-8bb0-1b4a01a4c454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:56.963273 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2d74a-8673-487c-8bb0-1b4a01a4c454 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:56.963774 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2d74a-8673-487c-8bb0-1b4a01a4c454 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:56.964244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2d74a-8673-487c-8bb0-1b4a01a4c454 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:56.965151 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2d74a-8673-487c-8bb0-1b4a01a4c454 None admin] RBAC: Adding query filter params (interface=public, service_id=a870caa2badc4964ab55f7e2e6f56eca, region_id=RegionOne) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:56.965663 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2d74a-8673-487c-8bb0-1b4a01a4c454 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:56.967228 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2d74a-8673-487c-8bb0-1b4a01a4c454 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:56.975981 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 352/699] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Sep 13 12:04:56 2022] GET /identity/v3/endpoints?service_id=a870caa2badc4964ab55f7e2e6f56eca&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:56.982101 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2d74a-8673-487c-8bb0-1b4a01a4c454 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:57.049089 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 348/700] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:56 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:04:57.121441 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2d74a-8673-487c-8bb0-1b4a01a4c454 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:57.168794 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105aed8-a193-4455-8291-b4c8028ed3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:57.169417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105aed8-a193-4455-8291-b4c8028ed3af None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:57.169697 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105aed8-a193-4455-8291-b4c8028ed3af None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:57.169972 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105aed8-a193-4455-8291-b4c8028ed3af None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:57.170587 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105aed8-a193-4455-8291-b4c8028ed3af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:57.171984 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105aed8-a193-4455-8291-b4c8028ed3af None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:57.179791 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 353/701] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Sep 13 12:04:56 2022] GET /identity/v3/services => generated 1002 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:04:57.187241 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5fb89-285f-40d9-a374-ce667b56807d None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:57.319909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5fb89-285f-40d9-a374-ce667b56807d None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:57.362159 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f30a22-4648-4abe-bf5a-ea41711487c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:57.362846 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f30a22-4648-4abe-bf5a-ea41711487c1 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:57.363134 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f30a22-4648-4abe-bf5a-ea41711487c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:57.363409 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f30a22-4648-4abe-bf5a-ea41711487c1 None admin] PATH_INFO: `/v3/services/network` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:57.364021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f30a22-4648-4abe-bf5a-ea41711487c1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:57.365470 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f30a22-4648-4abe-bf5a-ea41711487c1 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:57.375930 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-86f30a22-4648-4abe-bf5a-ea41711487c1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:04:57.375930 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:57.375930 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:04:57.375930 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:04:57.375930 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:04:57.375930 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:04:57.375930 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:04:57.375930 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:04:57.375930 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:04:57.375930 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:57.375930 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:04:57.375930 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:57.375930 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:57.375930 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:57.375930 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:57.375930 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:57.375930 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:57.376954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:57.376954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:57.376954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:57.376954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:57.376954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:57.376954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:57.376954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:04:57.376954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:04:57.376954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:04:57.376954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:04:57.376954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:57.376954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:57.376954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:57.376954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:57.376954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:57.376954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:57.377824 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:57.377824 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:57.377824 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:57.377824 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:57.377824 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:57.377824 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:57.377824 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:57.377824 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:57.377824 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:57.377824 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:57.377824 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:04:57.377824 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:04:57.377824 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:04:57.377824 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:57.377824 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 349/702] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:04:57 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:57.383317 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f30a22-4648-4abe-bf5a-ea41711487c1 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:57.383479 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64f04c-79b2-4c41-bda0-afb4303aa18f None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:57.383677 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64f04c-79b2-4c41-bda0-afb4303aa18f None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:57.384284 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64f04c-79b2-4c41-bda0-afb4303aa18f None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:57.386886 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 354/703] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:57.391065 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c70280-0fb0-4dd3-acee-4275625f897d None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:57.391374 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c70280-0fb0-4dd3-acee-4275625f897d None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:57.391838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c70280-0fb0-4dd3-acee-4275625f897d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:57.408242 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:57.412159 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-65c70280-0fb0-4dd3-acee-4275625f897d None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:57.413364 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-65c70280-0fb0-4dd3-acee-4275625f897d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:57.441120 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:57.515282 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 355/704] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:57 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:04:57.517690 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c70280-0fb0-4dd3-acee-4275625f897d None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:57.530294 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f30a22-4648-4abe-bf5a-ea41711487c1 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:57.582994 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f8c91-f9db-4e1d-8ab4-718161518a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:57.583662 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f8c91-f9db-4e1d-8ab4-718161518a9d None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:57.584215 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f8c91-f9db-4e1d-8ab4-718161518a9d None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:57.584331 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f8c91-f9db-4e1d-8ab4-718161518a9d None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:57.584953 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f8c91-f9db-4e1d-8ab4-718161518a9d None admin] RBAC: Adding query filter params (name=network) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:57.585267 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f8c91-f9db-4e1d-8ab4-718161518a9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:57.586677 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f8c91-f9db-4e1d-8ab4-718161518a9d None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:57.592652 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 350/705] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Sep 13 12:04:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:57.598468 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f8c91-f9db-4e1d-8ab4-718161518a9d None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:57.653075 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c70280-0fb0-4dd3-acee-4275625f897d None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:57.701544 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:57.704723 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03b6cc-fc0d-4407-8f16-613a649f0edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:57.706178 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03b6cc-fc0d-4407-8f16-613a649f0edd None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:57.706796 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03b6cc-fc0d-4407-8f16-613a649f0edd None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:57.707998 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03b6cc-fc0d-4407-8f16-613a649f0edd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:57.709441 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03b6cc-fc0d-4407-8f16-613a649f0edd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:57.711358 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03b6cc-fc0d-4407-8f16-613a649f0edd None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:57.726190 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-5b03b6cc-fc0d-4407-8f16-613a649f0edd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:04:57.726190 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:57.726190 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:04:57.726190 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:04:57.726190 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:04:57.726190 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:04:57.726190 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:04:57.726190 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:04:57.726190 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:04:57.726190 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:57.726190 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:04:57.726190 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:57.726190 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:57.726190 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:57.726190 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:57.726190 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:57.726190 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:57.727367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:57.727367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:57.727367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:57.727367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:57.727367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:57.727367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:57.727367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:04:57.727367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:04:57.727367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:04:57.727367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:04:57.727367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:57.727367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:57.727367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:57.727367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:57.727367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:57.727367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:57.728198 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:57.728198 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:57.728198 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:57.728198 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:57.728198 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:57.728198 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:57.728198 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:57.728198 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:57.728198 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:57.728198 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:57.728198 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:04:57.728198 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:04:57.728198 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:04:57.728198 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:57.731360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 356/706] 10.222.0.15 () {56 vars in 1129 bytes} [Tue Sep 13 12:04:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:57.732828 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f8c91-f9db-4e1d-8ab4-718161518a9d None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:57.737017 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03b6cc-fc0d-4407-8f16-613a649f0edd None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:57.757929 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:57.775876 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dca7b1-f9db-4c09-8d4b-9eeca99cea24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:57.776916 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dca7b1-f9db-4c09-8d4b-9eeca99cea24 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:57.777431 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dca7b1-f9db-4c09-8d4b-9eeca99cea24 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:57.777888 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dca7b1-f9db-4c09-8d4b-9eeca99cea24 None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:57.778759 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dca7b1-f9db-4c09-8d4b-9eeca99cea24 None admin] RBAC: Adding query filter params (type=network) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:57.779343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dca7b1-f9db-4c09-8d4b-9eeca99cea24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:57.781121 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dca7b1-f9db-4c09-8d4b-9eeca99cea24 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:57.792399 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 351/707] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Sep 13 12:04:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:57.794898 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dca7b1-f9db-4c09-8d4b-9eeca99cea24 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:57.866953 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03b6cc-fc0d-4407-8f16-613a649f0edd None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:57.904116 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b148214-8677-4f23-b2f5-2ee3adad0382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:57.904641 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b148214-8677-4f23-b2f5-2ee3adad0382 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:57.904918 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b148214-8677-4f23-b2f5-2ee3adad0382 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:57.905188 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b148214-8677-4f23-b2f5-2ee3adad0382 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:57.905824 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b148214-8677-4f23-b2f5-2ee3adad0382 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:57.906123 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b148214-8677-4f23-b2f5-2ee3adad0382 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:57.908058 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b148214-8677-4f23-b2f5-2ee3adad0382 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:57.913607 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 357/708] 10.222.0.15 () {56 vars in 1124 bytes} [Tue Sep 13 12:04:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:57.914466 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b148214-8677-4f23-b2f5-2ee3adad0382 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:57.923765 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dca7b1-f9db-4c09-8d4b-9eeca99cea24 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:57.962132 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f951ad5-bc20-4d2b-8452-6ef710fa194c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:57.962773 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f951ad5-bc20-4d2b-8452-6ef710fa194c None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:57.963055 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f951ad5-bc20-4d2b-8452-6ef710fa194c None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:57.963321 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f951ad5-bc20-4d2b-8452-6ef710fa194c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:57.964016 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f951ad5-bc20-4d2b-8452-6ef710fa194c None admin] RBAC: Adding query filter params (interface=public, service_id=4758d88320dd485496e3320d203b98a0, region_id=RegionOne) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:57.964319 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f951ad5-bc20-4d2b-8452-6ef710fa194c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:57.965766 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f951ad5-bc20-4d2b-8452-6ef710fa194c None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:57.978644 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 352/709] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Sep 13 12:04:57 2022] GET /identity/v3/endpoints?service_id=4758d88320dd485496e3320d203b98a0&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:57.978644 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f951ad5-bc20-4d2b-8452-6ef710fa194c None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:57.982903 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:58.015519 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:58.045411 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b148214-8677-4f23-b2f5-2ee3adad0382 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:58.084168 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a912a-4cb2-4232-b3c5-7d434e42a9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:58.084795 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a912a-4cb2-4232-b3c5-7d434e42a9b9 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:58.085076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a912a-4cb2-4232-b3c5-7d434e42a9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:58.085354 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a912a-4cb2-4232-b3c5-7d434e42a9b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:58.091171 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f951ad5-bc20-4d2b-8452-6ef710fa194c None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:58.097270 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a912a-4cb2-4232-b3c5-7d434e42a9b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:04:58.102677 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-233a912a-4cb2-4232-b3c5-7d434e42a9b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:58.102677 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:58.102677 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:58.102677 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:58.102677 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:58.102677 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:58.102677 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:58.102677 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:58.102677 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:58.102677 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:58.102677 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:58.102677 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:58.102677 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:04:58.102677 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:04:58.102677 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:04:58.102677 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:04:58.103624 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:04:58.103624 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:04:58.103624 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:04:58.103624 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:04:58.103624 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:58.103624 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:58.103624 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:58.103624 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:58.103624 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:58.103624 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:58.103624 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:58.103624 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:58.103624 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:58.103624 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:58.103624 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:58.103624 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:58.104453 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:58.104453 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:58.104453 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:58.104453 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:58.104453 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:04:58.104453 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:04:58.104453 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:04:58.104453 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:04:58.104453 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:04:58.104453 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:04:58.104453 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:04:58.104453 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:58.108744 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 358/710] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Sep 13 12:04:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:58.109671 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a912a-4cb2-4232-b3c5-7d434e42a9b9 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:58.131257 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e869a-8da2-4988-9520-f79179a5e5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:58.131864 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e869a-8da2-4988-9520-f79179a5e5d2 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:58.132138 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e869a-8da2-4988-9520-f79179a5e5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:58.132404 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e869a-8da2-4988-9520-f79179a5e5d2 None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:58.133032 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e869a-8da2-4988-9520-f79179a5e5d2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:58.133322 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e869a-8da2-4988-9520-f79179a5e5d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:58.134715 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e869a-8da2-4988-9520-f79179a5e5d2 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:58.142780 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 353/711] 10.222.0.15 () {56 vars in 1124 bytes} [Tue Sep 13 12:04:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:58.142780 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e869a-8da2-4988-9520-f79179a5e5d2 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:58.221824 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a912a-4cb2-4232-b3c5-7d434e42a9b9 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:58.230287 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:58.265823 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2908e6e-8550-47e8-b913-e942f3e498c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:58.267080 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2908e6e-8550-47e8-b913-e942f3e498c1 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:58.267358 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2908e6e-8550-47e8-b913-e942f3e498c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:58.267616 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2908e6e-8550-47e8-b913-e942f3e498c1 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:58.268390 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2908e6e-8550-47e8-b913-e942f3e498c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:58.270114 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2908e6e-8550-47e8-b913-e942f3e498c1 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:58.286647 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 359/712] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Sep 13 12:04:58 2022] GET /identity/v3/services => generated 1002 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:04:58.286647 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2908e6e-8550-47e8-b913-e942f3e498c1 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:58.286937 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e869a-8da2-4988-9520-f79179a5e5d2 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:58.287046 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:58.349481 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b4605-1ed5-49c1-985e-9e9466923596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:58.350120 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b4605-1ed5-49c1-985e-9e9466923596 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:58.350396 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b4605-1ed5-49c1-985e-9e9466923596 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:58.350730 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b4605-1ed5-49c1-985e-9e9466923596 None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:58.351635 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b4605-1ed5-49c1-985e-9e9466923596 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:58.352364 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b4605-1ed5-49c1-985e-9e9466923596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:58.353768 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b4605-1ed5-49c1-985e-9e9466923596 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:58.369109 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 354/713] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:04:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:58.375220 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b4605-1ed5-49c1-985e-9e9466923596 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:58.425542 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2908e6e-8550-47e8-b913-e942f3e498c1 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:58.466462 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911cf26-e2eb-4bf3-babd-5bd6b4d74b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:58.467276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911cf26-e2eb-4bf3-babd-5bd6b4d74b7a None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:58.467632 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911cf26-e2eb-4bf3-babd-5bd6b4d74b7a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:58.467973 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7911cf26-e2eb-4bf3-babd-5bd6b4d74b7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:58.468800 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911cf26-e2eb-4bf3-babd-5bd6b4d74b7a None admin] RBAC: Adding query filter params (interface=public, service_id=687bc1601ccb45a698f0ab7b4174a92f, region_id=RegionOne) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:58.469187 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911cf26-e2eb-4bf3-babd-5bd6b4d74b7a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:58.470904 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7911cf26-e2eb-4bf3-babd-5bd6b4d74b7a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:58.482588 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 360/714] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Sep 13 12:04:58 2022] GET /identity/v3/endpoints?service_id=687bc1601ccb45a698f0ab7b4174a92f&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:58.484062 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911cf26-e2eb-4bf3-babd-5bd6b4d74b7a None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:58.505341 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b4605-1ed5-49c1-985e-9e9466923596 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:58.558454 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:58.562139 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:58.569532 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e4821-f2a2-434a-84cc-cee897360e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:58.569532 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e4821-f2a2-434a-84cc-cee897360e6e None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:58.569532 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e4821-f2a2-434a-84cc-cee897360e6e None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:58.569532 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e4821-f2a2-434a-84cc-cee897360e6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:58.582728 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e4821-f2a2-434a-84cc-cee897360e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:58.584625 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e4821-f2a2-434a-84cc-cee897360e6e None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:58.602695 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-b65e4821-f2a2-434a-84cc-cee897360e6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:58.602695 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:58.602695 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:58.602695 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:58.602695 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:58.602695 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:58.602695 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:58.602695 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:58.602695 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:58.602695 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:58.602695 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:58.602695 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:58.602695 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:58.602695 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:58.602695 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:58.602695 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:58.603910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:58.603910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:58.603910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:58.603910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:58.603910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:58.603910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:58.603910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:58.603910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:58.603910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:58.603910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:58.603910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:58.603910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:58.603910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:58.603910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:58.603910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:58.603910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:58.603910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:58.604962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:58.604962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:58.604962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:58.607271 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 355/715] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:04:58.613810 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e4821-f2a2-434a-84cc-cee897360e6e None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:58.621275 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7911cf26-e2eb-4bf3-babd-5bd6b4d74b7a None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:58.670041 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ad526-20f8-4fd2-8da1-3a9efeaa775b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:58.670954 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ad526-20f8-4fd2-8da1-3a9efeaa775b None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:58.671483 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ad526-20f8-4fd2-8da1-3a9efeaa775b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:58.671994 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ad526-20f8-4fd2-8da1-3a9efeaa775b None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:58.672885 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ad526-20f8-4fd2-8da1-3a9efeaa775b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:58.674647 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ad526-20f8-4fd2-8da1-3a9efeaa775b None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:58.682290 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 361/716] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Sep 13 12:04:58 2022] GET /identity/v3/services => generated 1002 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:04:58.754192 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e4821-f2a2-434a-84cc-cee897360e6e None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:58.796284 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5e4a0-7a4d-4154-8781-e4820ce76ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:58.796905 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5e4a0-7a4d-4154-8781-e4820ce76ffb None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:58.797230 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5e4a0-7a4d-4154-8781-e4820ce76ffb None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:58.797582 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5e4a0-7a4d-4154-8781-e4820ce76ffb None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:58.798457 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5e4a0-7a4d-4154-8781-e4820ce76ffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:58.798818 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5e4a0-7a4d-4154-8781-e4820ce76ffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:58.800273 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5e4a0-7a4d-4154-8781-e4820ce76ffb None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:58.816458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 356/717] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:04:58.824109 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ad526-20f8-4fd2-8da1-3a9efeaa775b None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:58.945107 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ad526-20f8-4fd2-8da1-3a9efeaa775b None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:58.979914 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:58.983899 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85ffa1-d00e-46df-85b6-f3f7050dfc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:58.984756 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85ffa1-d00e-46df-85b6-f3f7050dfc3c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:58.985261 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85ffa1-d00e-46df-85b6-f3f7050dfc3c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:58.985652 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85ffa1-d00e-46df-85b6-f3f7050dfc3c None admin] PATH_INFO: `/v3/users/nova` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:58.997685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85ffa1-d00e-46df-85b6-f3f7050dfc3c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:58.999230 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85ffa1-d00e-46df-85b6-f3f7050dfc3c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:59.012428 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-4c85ffa1-d00e-46df-85b6-f3f7050dfc3c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:04:59.012428 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:59.012428 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:59.012428 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:59.012428 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:59.012428 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:59.012428 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:59.012428 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:59.012428 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:59.012428 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:59.012428 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:59.012428 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:59.012428 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:04:59.012428 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:04:59.012428 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:04:59.012428 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:04:59.013417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:59.013417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:59.013417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:04:59.013417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:59.013417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:04:59.013417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:04:59.013417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:59.013417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:59.013417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:59.013417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:59.013417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:59.013417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:59.013417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:59.013417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:59.013417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:59.013417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:59.013417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:59.013417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:59.014364 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:59.014364 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:59.014364 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:04:59.014364 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:04:59.014364 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:04:59.014364 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:04:59.014364 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:04:59.014364 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:04:59.014364 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 12:04:59.014364 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:04:59.014364 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 362/718] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Sep 13 12:04:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:59.021930 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5e4a0-7a4d-4154-8781-e4820ce76ffb None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:59.078158 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:59.155170 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5e4a0-7a4d-4154-8781-e4820ce76ffb None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:59.193752 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ecec1-545d-4e19-b783-f7cd5ccf28eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:59.194365 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ecec1-545d-4e19-b783-f7cd5ccf28eb None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:59.194669 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ecec1-545d-4e19-b783-f7cd5ccf28eb None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:59.194951 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ecec1-545d-4e19-b783-f7cd5ccf28eb None admin] PATH_INFO: `/v3/users` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:59.195690 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ecec1-545d-4e19-b783-f7cd5ccf28eb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:59.196002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ecec1-545d-4e19-b783-f7cd5ccf28eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:59.197464 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ecec1-545d-4e19-b783-f7cd5ccf28eb None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:59.218057 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 357/719] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Sep 13 12:04:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:04:59.224175 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85ffa1-d00e-46df-85b6-f3f7050dfc3c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:59.352583 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85ffa1-d00e-46df-85b6-f3f7050dfc3c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:59.388301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d71ac2-0e28-498d-a7ed-f943345b47c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:59.388915 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d71ac2-0e28-498d-a7ed-f943345b47c6 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:59.389195 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d71ac2-0e28-498d-a7ed-f943345b47c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:59.389467 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d71ac2-0e28-498d-a7ed-f943345b47c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:59.471276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:59.474965 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d71ac2-0e28-498d-a7ed-f943345b47c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:59.476800 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d71ac2-0e28-498d-a7ed-f943345b47c6 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:59.591092 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 363/720] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:04:59 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:04:59.597412 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ecec1-545d-4e19-b783-f7cd5ccf28eb None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:59.731608 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ecec1-545d-4e19-b783-f7cd5ccf28eb None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:59.735658 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:59.772046 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff335c5-2ea8-4147-9375-057e44d04665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:59.772701 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff335c5-2ea8-4147-9375-057e44d04665 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:59.772981 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff335c5-2ea8-4147-9375-057e44d04665 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:59.773257 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff335c5-2ea8-4147-9375-057e44d04665 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:59.784775 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff335c5-2ea8-4147-9375-057e44d04665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:59.786771 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff335c5-2ea8-4147-9375-057e44d04665 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:04:59.802962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-fff335c5-2ea8-4147-9375-057e44d04665 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:59.802962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:04:59.802962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:04:59.802962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:04:59.802962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:04:59.802962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:04:59.802962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:04:59.802962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:04:59.802962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:04:59.802962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:04:59.802962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:04:59.802962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:04:59.802962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:04:59.802962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:04:59.802962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:04:59.802962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:04:59.804761 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:04:59.804761 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:04:59.804761 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:04:59.804761 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:04:59.804761 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:04:59.804761 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:04:59.804761 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:04:59.804761 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:04:59.804761 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:04:59.804761 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:04:59.804761 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:04:59.804761 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:04:59.804761 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:04:59.804761 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:04:59.804761 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:04:59.804761 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:04:59.804761 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:04:59.806035 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:04:59.806035 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:04:59.806035 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:04:59.806035 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 358/721] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:04:59.809926 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d71ac2-0e28-498d-a7ed-f943345b47c6 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:04:59.916686 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f62485-5c50-46ec-9fa0-970338894228 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:59.916990 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f62485-5c50-46ec-9fa0-970338894228 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:59.917326 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f62485-5c50-46ec-9fa0-970338894228 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:59.918856 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 359/722] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:04:59.926061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933cf3a-8108-40f8-b120-a62c5ecf80d7 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:59.926411 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933cf3a-8108-40f8-b120-a62c5ecf80d7 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:59.926655 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933cf3a-8108-40f8-b120-a62c5ecf80d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:59.928819 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:04:59.946455 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d71ac2-0e28-498d-a7ed-f943345b47c6 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:04:59.961103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-7933cf3a-8108-40f8-b120-a62c5ecf80d7 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:04:59.963469 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-7933cf3a-8108-40f8-b120-a62c5ecf80d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:04:59.988987 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae8f8c-eb9c-449a-83eb-cda002a29289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:04:59.989706 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae8f8c-eb9c-449a-83eb-cda002a29289 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:04:59.989990 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae8f8c-eb9c-449a-83eb-cda002a29289 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:04:59.990262 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae8f8c-eb9c-449a-83eb-cda002a29289 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:04:59.991036 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae8f8c-eb9c-449a-83eb-cda002a29289 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:04:59.991363 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae8f8c-eb9c-449a-83eb-cda002a29289 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:04:59.992702 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae8f8c-eb9c-449a-83eb-cda002a29289 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:00.007795 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 364/723] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:00.013087 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae8f8c-eb9c-449a-83eb-cda002a29289 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:00.074695 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 360/724] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:04:59 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:05:00.137254 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae8f8c-eb9c-449a-83eb-cda002a29289 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:00.175039 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2a9ef-f7f1-45c9-ac3b-810924d33ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:00.176064 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2a9ef-f7f1-45c9-ac3b-810924d33ac9 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:00.176619 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2a9ef-f7f1-45c9-ac3b-810924d33ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:00.177102 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2a9ef-f7f1-45c9-ac3b-810924d33ac9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:00.185029 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2a9ef-f7f1-45c9-ac3b-810924d33ac9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:00.186868 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2a9ef-f7f1-45c9-ac3b-810924d33ac9 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:00.205294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-9bb2a9ef-f7f1-45c9-ac3b-810924d33ac9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:05:00.205294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:00.205294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:05:00.205294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:05:00.205294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:05:00.205294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:05:00.205294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:05:00.205294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:05:00.205294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:05:00.205294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:05:00.205294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:05:00.205294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:05:00.205294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:05:00.205294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:05:00.205294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:05:00.206731 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:05:00.206731 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:05:00.206731 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:05:00.206731 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:05:00.206731 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:05:00.206731 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:05:00.206731 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:05:00.206731 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:05:00.206731 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:05:00.206731 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:05:00.206731 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:05:00.206731 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:05:00.206731 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:05:00.206731 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:05:00.206731 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:05:00.206731 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:05:00.206731 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:05:00.208572 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:05:00.208572 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:05:00.208572 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:05:00.208572 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:05:00.208572 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:05:00.208572 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:05:00.208572 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:05:00.208572 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:00.212342 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 365/725] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:05:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:05:00.221462 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933cf3a-8108-40f8-b120-a62c5ecf80d7 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:00.322750 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:00.343666 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933cf3a-8108-40f8-b120-a62c5ecf80d7 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:00.387567 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db00c52-9c79-46e6-816f-e3852a7e6711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:00.388186 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db00c52-9c79-46e6-816f-e3852a7e6711 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:00.388469 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db00c52-9c79-46e6-816f-e3852a7e6711 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:00.388740 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db00c52-9c79-46e6-816f-e3852a7e6711 None admin] PATH_INFO: `/v3/projects` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:00.389450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db00c52-9c79-46e6-816f-e3852a7e6711 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:00.389759 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db00c52-9c79-46e6-816f-e3852a7e6711 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:00.391454 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db00c52-9c79-46e6-816f-e3852a7e6711 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:00.405182 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 361/726] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Sep 13 12:05:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:00.411846 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2a9ef-f7f1-45c9-ac3b-810924d33ac9 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:00.434568 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:00.450915 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db00c52-9c79-46e6-816f-e3852a7e6711 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:00.547115 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2a9ef-f7f1-45c9-ac3b-810924d33ac9 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:00.601048 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba107857-c41b-4809-b8f2-68575ce6683f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:00.602108 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba107857-c41b-4809-b8f2-68575ce6683f None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:00.602661 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba107857-c41b-4809-b8f2-68575ce6683f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:00.603208 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba107857-c41b-4809-b8f2-68575ce6683f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:00.604257 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba107857-c41b-4809-b8f2-68575ce6683f None admin] RBAC: Adding query filter params (role.id=5609ac7373ba400593bba6d811e3aa72, scope.project.id=2cd599a81e8043bebfca960673e63bbc, user.id=e740dc7330284b0bbe6a825186f0a55d) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:00.604770 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db00c52-9c79-46e6-816f-e3852a7e6711 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:00.605034 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba107857-c41b-4809-b8f2-68575ce6683f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:00.606787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba107857-c41b-4809-b8f2-68575ce6683f None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:00.619027 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 366/727] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:05:00 2022] GET /identity/v3/role_assignments?user.id=e740dc7330284b0bbe6a825186f0a55d&scope.project.id=2cd599a81e8043bebfca960673e63bbc&role.id=5609ac7373ba400593bba6d811e3aa72 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:00.649342 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49012f-ced9-40a8-8878-960313c8242f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:00.649995 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49012f-ced9-40a8-8878-960313c8242f None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:00.651043 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49012f-ced9-40a8-8878-960313c8242f None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:00.651346 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49012f-ced9-40a8-8878-960313c8242f None admin] PATH_INFO: `/v3/services/image` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:00.651958 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49012f-ced9-40a8-8878-960313c8242f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:00.653394 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49012f-ced9-40a8-8878-960313c8242f None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:00.676538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-fb49012f-ced9-40a8-8878-960313c8242f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:05:00.676538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:00.676538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:05:00.676538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:05:00.676538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:05:00.676538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:05:00.676538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:05:00.676538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:05:00.676538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:05:00.676538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:00.676538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:05:00.676538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:00.676538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:00.676538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:05:00.676538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:05:00.676538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:05:00.676538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:05:00.677632 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:05:00.677632 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:05:00.677632 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:05:00.677632 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:05:00.677632 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:05:00.677632 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:05:00.677632 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:05:00.677632 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:05:00.677632 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:05:00.677632 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:05:00.677632 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:05:00.677632 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:05:00.677632 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:05:00.677632 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:05:00.677632 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:05:00.677632 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:05:00.678493 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:05:00.678493 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:05:00.678493 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:05:00.678493 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:05:00.678493 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:05:00.678493 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:05:00.678493 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:05:00.678493 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:05:00.678493 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:05:00.678493 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:05:00.678493 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:05:00.678493 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:05:00.678493 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 12:05:00.678493 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:00.678493 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 362/728] 10.222.0.15 () {56 vars in 1105 bytes} [Tue Sep 13 12:05:00 2022] GET /identity/v3/services/image => generated 86 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:05:00.686135 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba107857-c41b-4809-b8f2-68575ce6683f None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:00.795007 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:00.817079 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba107857-c41b-4809-b8f2-68575ce6683f None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:00.858387 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55849b6-45ae-4ef0-b1df-dca8d22038d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:00.859048 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55849b6-45ae-4ef0-b1df-dca8d22038d6 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:00.859326 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55849b6-45ae-4ef0-b1df-dca8d22038d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:00.859595 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55849b6-45ae-4ef0-b1df-dca8d22038d6 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:00.860519 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55849b6-45ae-4ef0-b1df-dca8d22038d6 None admin] RBAC: Adding query filter params (name=image) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:00.860856 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55849b6-45ae-4ef0-b1df-dca8d22038d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:00.862233 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55849b6-45ae-4ef0-b1df-dca8d22038d6 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:00.867893 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 367/729] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:05:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:00.873459 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49012f-ced9-40a8-8878-960313c8242f None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:01.021469 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:01.054192 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22bf0b-b4e2-4013-99b8-cadabae30c5e None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:01.054762 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22bf0b-b4e2-4013-99b8-cadabae30c5e None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:01.054762 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22bf0b-b4e2-4013-99b8-cadabae30c5e None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:01.056388 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 368/730] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:05:01.061811 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471f948-45f2-4d6c-b580-13db410020ef None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:01.062111 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471f948-45f2-4d6c-b580-13db410020ef None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:01.062386 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471f948-45f2-4d6c-b580-13db410020ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:01.083402 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-8471f948-45f2-4d6c-b580-13db410020ef None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:05:01.084626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-8471f948-45f2-4d6c-b580-13db410020ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:05:01.173769 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49012f-ced9-40a8-8878-960313c8242f None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:01.178018 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 369/731] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:05:01 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:05:01.212057 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0592ee-ac8a-4086-bfe0-de2c3fd28429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:01.212660 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0592ee-ac8a-4086-bfe0-de2c3fd28429 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:01.212937 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0592ee-ac8a-4086-bfe0-de2c3fd28429 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:01.213211 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0592ee-ac8a-4086-bfe0-de2c3fd28429 None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:01.213851 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0592ee-ac8a-4086-bfe0-de2c3fd28429 None admin] RBAC: Adding query filter params (type=image) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:01.214152 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0592ee-ac8a-4086-bfe0-de2c3fd28429 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:01.215558 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0592ee-ac8a-4086-bfe0-de2c3fd28429 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:01.222504 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 363/732] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:05:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:05:01.230010 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471f948-45f2-4d6c-b580-13db410020ef None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:01.313935 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:01.351024 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471f948-45f2-4d6c-b580-13db410020ef None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:01.387507 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebca7a-9f0a-41de-9707-e824f7f15ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:01.388128 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebca7a-9f0a-41de-9707-e824f7f15ad9 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:01.388408 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebca7a-9f0a-41de-9707-e824f7f15ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:01.388679 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebca7a-9f0a-41de-9707-e824f7f15ad9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:01.389426 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ebca7a-9f0a-41de-9707-e824f7f15ad9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:01.390828 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ebca7a-9f0a-41de-9707-e824f7f15ad9 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:01.416758 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 370/733] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Sep 13 12:05:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:05:01.488577 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93f0bb-d3df-433e-8a25-e4f6fe5f1547 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:01.488941 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93f0bb-d3df-433e-8a25-e4f6fe5f1547 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:01.489121 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd93f0bb-d3df-433e-8a25-e4f6fe5f1547 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:01.490893 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 364/734] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:05:01.497663 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf250cb7-2cc1-48a0-956c-11dbf4ce4c45 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:01.497971 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf250cb7-2cc1-48a0-956c-11dbf4ce4c45 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:01.498217 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf250cb7-2cc1-48a0-956c-11dbf4ce4c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:01.523384 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-bf250cb7-2cc1-48a0-956c-11dbf4ce4c45 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:05:01.525247 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-bf250cb7-2cc1-48a0-956c-11dbf4ce4c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:05:01.543541 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93f0bb-d3df-433e-8a25-e4f6fe5f1547 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:01.646850 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 371/735] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:05:01 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:05:01.650455 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:01.694297 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd93f0bb-d3df-433e-8a25-e4f6fe5f1547 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:01.730629 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126713d-6a83-4397-8745-0e338314bcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:01.731260 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126713d-6a83-4397-8745-0e338314bcd0 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:01.731531 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126713d-6a83-4397-8745-0e338314bcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:01.731799 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126713d-6a83-4397-8745-0e338314bcd0 None admin] PATH_INFO: `/v3/services/network` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:01.732435 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126713d-6a83-4397-8745-0e338314bcd0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:01.733832 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126713d-6a83-4397-8745-0e338314bcd0 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:01.743351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-f126713d-6a83-4397-8745-0e338314bcd0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:05:01.743351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:01.743351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:05:01.743351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:05:01.743351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:05:01.743351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:05:01.743351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:05:01.743351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:05:01.743351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:05:01.743351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:01.743351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:05:01.743351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:01.743351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:01.743351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:05:01.743351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:05:01.743351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:05:01.743351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:05:01.744993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:05:01.744993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:05:01.744993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:05:01.744993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:05:01.744993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:05:01.744993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:05:01.744993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:05:01.744993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:05:01.744993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:05:01.744993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:05:01.744993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:05:01.744993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:05:01.744993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:05:01.744993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:05:01.744993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:05:01.744993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:05:01.746440 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:05:01.746440 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:05:01.746440 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:05:01.746440 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:05:01.746440 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:05:01.746440 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:05:01.746440 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:05:01.746440 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:05:01.746440 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:05:01.746440 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:05:01.746440 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:05:01.746440 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:05:01.746440 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 12:05:01.746440 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:01.746440 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 365/736] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:05:01 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:05:01.753093 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf250cb7-2cc1-48a0-956c-11dbf4ce4c45 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:01.810402 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:01.869620 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf250cb7-2cc1-48a0-956c-11dbf4ce4c45 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:01.908960 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54f878-c9ff-4823-9ec9-d1da177f0c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:01.909488 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54f878-c9ff-4823-9ec9-d1da177f0c5a None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:01.909769 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54f878-c9ff-4823-9ec9-d1da177f0c5a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:01.910047 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54f878-c9ff-4823-9ec9-d1da177f0c5a None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:01.910711 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54f878-c9ff-4823-9ec9-d1da177f0c5a None admin] RBAC: Adding query filter params (name=network) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:01.911082 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54f878-c9ff-4823-9ec9-d1da177f0c5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:01.912456 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54f878-c9ff-4823-9ec9-d1da177f0c5a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:01.918068 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 372/737] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Sep 13 12:05:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:01.923787 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126713d-6a83-4397-8745-0e338314bcd0 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:01.992002 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54f878-c9ff-4823-9ec9-d1da177f0c5a None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:02.055529 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126713d-6a83-4397-8745-0e338314bcd0 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:02.098538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5b79c-83cf-4549-9c32-97b64652f779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:02.099187 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5b79c-83cf-4549-9c32-97b64652f779 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:02.099468 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5b79c-83cf-4549-9c32-97b64652f779 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:02.099745 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5b79c-83cf-4549-9c32-97b64652f779 None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:02.100390 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5b79c-83cf-4549-9c32-97b64652f779 None admin] RBAC: Adding query filter params (type=network) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:02.100697 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5b79c-83cf-4549-9c32-97b64652f779 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:02.102072 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5b79c-83cf-4549-9c32-97b64652f779 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:02.103463 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:02.114664 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 366/738] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Sep 13 12:05:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:02.117066 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5b79c-83cf-4549-9c32-97b64652f779 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:02.137215 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54f878-c9ff-4823-9ec9-d1da177f0c5a None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:02.160442 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:02.191434 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d4060-0f79-4eaf-88e0-246a676e2106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:02.192652 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d4060-0f79-4eaf-88e0-246a676e2106 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:02.192955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d4060-0f79-4eaf-88e0-246a676e2106 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:02.193311 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d4060-0f79-4eaf-88e0-246a676e2106 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:02.194342 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d4060-0f79-4eaf-88e0-246a676e2106 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:02.196764 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d4060-0f79-4eaf-88e0-246a676e2106 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:02.207679 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-a37d4060-0f79-4eaf-88e0-246a676e2106 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:05:02.207679 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:02.207679 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:05:02.207679 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:05:02.207679 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:05:02.207679 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:05:02.207679 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:05:02.207679 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:05:02.207679 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:05:02.207679 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:02.207679 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:05:02.207679 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:02.207679 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:02.207679 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:05:02.207679 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:05:02.207679 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:05:02.207679 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:05:02.208699 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:05:02.208699 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:05:02.208699 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:05:02.208699 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:05:02.208699 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:05:02.208699 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:05:02.208699 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:05:02.208699 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:05:02.208699 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:05:02.208699 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:05:02.208699 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:05:02.208699 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:05:02.208699 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:05:02.208699 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:05:02.208699 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:05:02.208699 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:05:02.209626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:05:02.209626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:05:02.209626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:05:02.209626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:05:02.209626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:05:02.209626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:05:02.209626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:05:02.209626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:05:02.209626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:05:02.209626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:05:02.209626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:05:02.209626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:05:02.209626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 12:05:02.209626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:02.209626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 373/739] 10.222.0.15 () {56 vars in 1129 bytes} [Tue Sep 13 12:05:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:05:02.215892 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d4060-0f79-4eaf-88e0-246a676e2106 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:02.245475 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5b79c-83cf-4549-9c32-97b64652f779 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:02.290497 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a4566-e3ee-47d4-aaaa-9c69b5ceb027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:02.291422 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a4566-e3ee-47d4-aaaa-9c69b5ceb027 None admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:02.291705 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a4566-e3ee-47d4-aaaa-9c69b5ceb027 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:02.291981 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a4566-e3ee-47d4-aaaa-9c69b5ceb027 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:02.293085 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a4566-e3ee-47d4-aaaa-9c69b5ceb027 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:02.294804 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a4566-e3ee-47d4-aaaa-9c69b5ceb027 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:02.326666 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 367/740] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Sep 13 12:05:02 2022] POST /identity/v3/endpoints => generated 337 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:05:02.370594 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d4060-0f79-4eaf-88e0-246a676e2106 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:02.420777 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02818669-1ea9-4e5b-8792-8d6e21e6adc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:02.421739 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02818669-1ea9-4e5b-8792-8d6e21e6adc9 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:02.422227 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02818669-1ea9-4e5b-8792-8d6e21e6adc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:02.423365 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02818669-1ea9-4e5b-8792-8d6e21e6adc9 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:02.424600 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02818669-1ea9-4e5b-8792-8d6e21e6adc9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:02.425107 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02818669-1ea9-4e5b-8792-8d6e21e6adc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:02.426817 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02818669-1ea9-4e5b-8792-8d6e21e6adc9 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:02.433252 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 374/741] 10.222.0.15 () {56 vars in 1124 bytes} [Tue Sep 13 12:05:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:05:02.439249 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a4566-e3ee-47d4-aaaa-9c69b5ceb027 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:02.508564 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:02.586487 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a4566-e3ee-47d4-aaaa-9c69b5ceb027 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:02.634927 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efc76c-108f-4260-8ed5-f91f095a98c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:02.635944 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efc76c-108f-4260-8ed5-f91f095a98c0 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:02.636418 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efc76c-108f-4260-8ed5-f91f095a98c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:02.636908 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efc76c-108f-4260-8ed5-f91f095a98c0 None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:02.637982 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efc76c-108f-4260-8ed5-f91f095a98c0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:02.638450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efc76c-108f-4260-8ed5-f91f095a98c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:02.640940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efc76c-108f-4260-8ed5-f91f095a98c0 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:02.647113 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 368/742] 10.222.0.15 () {56 vars in 1124 bytes} [Tue Sep 13 12:05:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:02.653198 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02818669-1ea9-4e5b-8792-8d6e21e6adc9 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:02.712597 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:02.782099 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02818669-1ea9-4e5b-8792-8d6e21e6adc9 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:02.821585 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a902c3-5b65-49a8-99ff-2a1ebd90e76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:02.822173 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a902c3-5b65-49a8-99ff-2a1ebd90e76b None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:02.822444 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a902c3-5b65-49a8-99ff-2a1ebd90e76b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:02.822757 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a902c3-5b65-49a8-99ff-2a1ebd90e76b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:02.823506 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a902c3-5b65-49a8-99ff-2a1ebd90e76b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:02.824869 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a902c3-5b65-49a8-99ff-2a1ebd90e76b None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:02.854664 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 375/743] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Sep 13 12:05:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:05:03.301261 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3f36c-26e2-46ff-bde3-fbd3f5fa02d2 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:03.301858 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3f36c-26e2-46ff-bde3-fbd3f5fa02d2 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:03.301858 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3f36c-26e2-46ff-bde3-fbd3f5fa02d2 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:03.303336 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 369/744] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:05:03.308731 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8653a-fa37-4d55-a8dc-071003181247 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:03.309261 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8653a-fa37-4d55-a8dc-071003181247 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:03.309261 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8653a-fa37-4d55-a8dc-071003181247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:03.328054 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-14b8653a-fa37-4d55-a8dc-071003181247 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:05:03.329357 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-14b8653a-fa37-4d55-a8dc-071003181247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:05:03.410100 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 376/745] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:05:03 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:05:03.736140 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3f36c-26e2-46ff-bde3-fbd3f5fa02d2 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:03.855464 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3f36c-26e2-46ff-bde3-fbd3f5fa02d2 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:03.881151 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:03.912189 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d41e45-2a07-4701-9e43-a5151d3d6253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:03.912879 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d41e45-2a07-4701-9e43-a5151d3d6253 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:03.913155 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d41e45-2a07-4701-9e43-a5151d3d6253 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:03.913426 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d41e45-2a07-4701-9e43-a5151d3d6253 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:03.914045 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d41e45-2a07-4701-9e43-a5151d3d6253 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:03.915444 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d41e45-2a07-4701-9e43-a5151d3d6253 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:03.925896 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-37d41e45-2a07-4701-9e43-a5151d3d6253 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:05:03.925896 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:03.925896 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:05:03.925896 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:05:03.925896 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:05:03.925896 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:05:03.925896 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:05:03.925896 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:05:03.925896 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:05:03.925896 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:03.925896 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:05:03.925896 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:03.925896 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:03.925896 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:05:03.925896 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:05:03.925896 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:05:03.926965 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:05:03.926965 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:05:03.926965 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:05:03.926965 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:05:03.926965 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:05:03.926965 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:05:03.926965 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:05:03.926965 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:05:03.926965 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:05:03.926965 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:05:03.926965 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:05:03.926965 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:05:03.926965 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:05:03.926965 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:05:03.926965 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:05:03.926965 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:05:03.926965 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:05:03.927868 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:05:03.927868 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:05:03.927868 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:05:03.927868 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:05:03.927868 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:05:03.927868 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:05:03.927868 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:05:03.927868 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:05:03.927868 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:05:03.927868 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:05:03.927868 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:05:03.927868 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:05:03.927868 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:05:03.927868 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:03.930988 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 370/746] 10.222.0.15 () {56 vars in 1132 bytes} [Tue Sep 13 12:05:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:05:03.932858 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8653a-fa37-4d55-a8dc-071003181247 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:03.961058 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:04.073198 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8653a-fa37-4d55-a8dc-071003181247 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:04.117032 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76deff92-5fd9-4122-b17c-c9a0eb7efc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:04.117650 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76deff92-5fd9-4122-b17c-c9a0eb7efc24 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:04.117930 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76deff92-5fd9-4122-b17c-c9a0eb7efc24 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:04.118202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76deff92-5fd9-4122-b17c-c9a0eb7efc24 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:04.118869 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76deff92-5fd9-4122-b17c-c9a0eb7efc24 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:04.119173 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76deff92-5fd9-4122-b17c-c9a0eb7efc24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:04.120541 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76deff92-5fd9-4122-b17c-c9a0eb7efc24 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:04.128887 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c625d84-6843-414d-a4ae-2b7b7a47fba3 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:04.129511 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c625d84-6843-414d-a4ae-2b7b7a47fba3 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:04.129911 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 377/747] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Sep 13 12:05:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:04.130212 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c625d84-6843-414d-a4ae-2b7b7a47fba3 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:04.131805 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 371/748] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:05:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:05:04.136668 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76deff92-5fd9-4122-b17c-c9a0eb7efc24 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:04.139576 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e512b-cbdd-4972-8911-0efc867d5180 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:04.139768 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e512b-cbdd-4972-8911-0efc867d5180 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:04.140193 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e512b-cbdd-4972-8911-0efc867d5180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:04.159671 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-587e512b-cbdd-4972-8911-0efc867d5180 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:05:04.160996 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-587e512b-cbdd-4972-8911-0efc867d5180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:05:04.240819 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 372/749] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:05:04 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:05:04.244596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:04.263901 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76deff92-5fd9-4122-b17c-c9a0eb7efc24 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:04.301506 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6aa6ad-b973-4861-8d3a-a648953f163a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:04.302117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6aa6ad-b973-4861-8d3a-a648953f163a None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:04.302393 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6aa6ad-b973-4861-8d3a-a648953f163a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:04.302690 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6aa6ad-b973-4861-8d3a-a648953f163a None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:04.303327 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6aa6ad-b973-4861-8d3a-a648953f163a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:04.303629 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6aa6ad-b973-4861-8d3a-a648953f163a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:04.304983 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6aa6ad-b973-4861-8d3a-a648953f163a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:04.310058 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 378/750] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Sep 13 12:05:04 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:05:04.564729 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e512b-cbdd-4972-8911-0efc867d5180 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:04.691940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e512b-cbdd-4972-8911-0efc867d5180 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:04.708215 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:04.731873 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8352f-4fe1-4854-90c4-6cc54f03a625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:04.732481 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8352f-4fe1-4854-90c4-6cc54f03a625 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:04.732760 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8352f-4fe1-4854-90c4-6cc54f03a625 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:04.733032 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8352f-4fe1-4854-90c4-6cc54f03a625 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:04.810458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8352f-4fe1-4854-90c4-6cc54f03a625 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:04.811937 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8352f-4fe1-4854-90c4-6cc54f03a625 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:04.927161 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 373/751] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:05:04 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:05:04.932770 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6aa6ad-b973-4861-8d3a-a648953f163a None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:05.046844 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6aa6ad-b973-4861-8d3a-a648953f163a None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:05.085492 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1416aa-96c3-45a3-9d2f-c5be4680d3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:05.086135 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1416aa-96c3-45a3-9d2f-c5be4680d3d0 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:05.086420 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1416aa-96c3-45a3-9d2f-c5be4680d3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:05.086736 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1416aa-96c3-45a3-9d2f-c5be4680d3d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:05.099871 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1416aa-96c3-45a3-9d2f-c5be4680d3d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:05.100064 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1416aa-96c3-45a3-9d2f-c5be4680d3d0 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:05.108604 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:05.116787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-5d1416aa-96c3-45a3-9d2f-c5be4680d3d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:05:05.116787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:05.116787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:05:05.116787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:05:05.116787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:05:05.116787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:05:05.116787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:05:05.116787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:05:05.116787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:05:05.116787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:05:05.116787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:05:05.116787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:05:05.116787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:05:05.116787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:05:05.116787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:05:05.116787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:05:05.119335 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:05:05.119335 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:05:05.119335 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:05:05.119335 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:05:05.119335 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:05:05.119335 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:05:05.119335 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:05:05.119335 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:05:05.119335 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:05:05.119335 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:05:05.119335 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:05:05.119335 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:05:05.119335 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:05:05.119335 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:05:05.119335 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:05:05.119335 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:05:05.119335 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:05:05.120239 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:05:05.120239 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:05:05.120239 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:05.126577 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 379/752] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:05:05.126765 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8352f-4fe1-4854-90c4-6cc54f03a625 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:05.139886 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:05.242437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8352f-4fe1-4854-90c4-6cc54f03a625 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:05.281668 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6625a99-6bc7-41e6-b649-bdce36e6a72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:05.282294 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6625a99-6bc7-41e6-b649-bdce36e6a72c None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:05.282605 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6625a99-6bc7-41e6-b649-bdce36e6a72c None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:05.282846 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6625a99-6bc7-41e6-b649-bdce36e6a72c None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:05.283530 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6625a99-6bc7-41e6-b649-bdce36e6a72c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:05.283826 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6625a99-6bc7-41e6-b649-bdce36e6a72c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:05.285189 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6625a99-6bc7-41e6-b649-bdce36e6a72c None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:05.298307 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 374/753] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:05.360956 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa52f80-7302-4131-91ba-b72d44834782 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:05.361770 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa52f80-7302-4131-91ba-b72d44834782 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:05.361770 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa52f80-7302-4131-91ba-b72d44834782 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:05.363087 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 380/754] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:05:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:05:05.368843 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13d6db-699b-42fc-91ed-e4afc66bc45f None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:05.369155 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13d6db-699b-42fc-91ed-e4afc66bc45f None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:05.369396 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13d6db-699b-42fc-91ed-e4afc66bc45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:05.391641 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-bd13d6db-699b-42fc-91ed-e4afc66bc45f None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:05:05.392885 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-bd13d6db-699b-42fc-91ed-e4afc66bc45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:05:05.507835 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 375/755] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:05:05 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:05:05.843716 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa52f80-7302-4131-91ba-b72d44834782 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:05.957813 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa52f80-7302-4131-91ba-b72d44834782 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:05.993786 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7c19f-dd62-4de4-a9a6-e0f85f74247d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:05.994417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7c19f-dd62-4de4-a9a6-e0f85f74247d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:05.994723 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7c19f-dd62-4de4-a9a6-e0f85f74247d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:05.994993 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7c19f-dd62-4de4-a9a6-e0f85f74247d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:05.995575 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7c19f-dd62-4de4-a9a6-e0f85f74247d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:05.996925 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7c19f-dd62-4de4-a9a6-e0f85f74247d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:06.006096 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-d2b7c19f-dd62-4de4-a9a6-e0f85f74247d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:05:06.006096 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:06.006096 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:05:06.006096 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:05:06.006096 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:05:06.006096 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:05:06.006096 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:05:06.006096 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:05:06.006096 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:05:06.006096 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:06.006096 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:05:06.006096 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:06.006096 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:06.006096 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:05:06.006096 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:05:06.006096 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:05:06.006096 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:05:06.007211 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:05:06.007211 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:05:06.007211 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:05:06.007211 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:05:06.007211 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:05:06.007211 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:05:06.007211 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:05:06.007211 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:05:06.007211 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:05:06.007211 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:05:06.007211 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:05:06.007211 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:05:06.007211 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:05:06.007211 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:05:06.007211 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:05:06.007211 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:05:06.008066 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:05:06.008066 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:05:06.008066 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:05:06.008066 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:05:06.008066 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:05:06.008066 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:05:06.008066 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:05:06.008066 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:05:06.008066 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:05:06.008066 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:05:06.008066 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:05:06.008066 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:05:06.008066 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:05:06.008066 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:06.008066 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 381/756] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Sep 13 12:05:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:05:06.014558 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13d6db-699b-42fc-91ed-e4afc66bc45f None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:06.017452 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:06.117431 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13d6db-699b-42fc-91ed-e4afc66bc45f None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:06.151165 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485835d7-a2a1-4bb7-97e7-ac38612aca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:06.151776 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485835d7-a2a1-4bb7-97e7-ac38612aca99 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:06.152051 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485835d7-a2a1-4bb7-97e7-ac38612aca99 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:06.152325 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485835d7-a2a1-4bb7-97e7-ac38612aca99 None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:06.152958 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485835d7-a2a1-4bb7-97e7-ac38612aca99 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:06.153258 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485835d7-a2a1-4bb7-97e7-ac38612aca99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:06.154659 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485835d7-a2a1-4bb7-97e7-ac38612aca99 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:06.169320 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 376/757] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Sep 13 12:05:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:06.170644 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7c19f-dd62-4de4-a9a6-e0f85f74247d None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:06.235157 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:06.277913 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7c19f-dd62-4de4-a9a6-e0f85f74247d None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:06.318932 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e821ea-ef15-4e26-b72b-49439a727fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:06.319544 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e821ea-ef15-4e26-b72b-49439a727fa4 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:06.319825 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e821ea-ef15-4e26-b72b-49439a727fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:06.320099 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e821ea-ef15-4e26-b72b-49439a727fa4 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:06.320736 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e821ea-ef15-4e26-b72b-49439a727fa4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:06.321041 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e821ea-ef15-4e26-b72b-49439a727fa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:06.322399 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e821ea-ef15-4e26-b72b-49439a727fa4 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:06.327459 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 382/758] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Sep 13 12:05:06 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:06.849852 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179c3f7-56b9-4066-81fc-c484161c3800 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:06.850134 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179c3f7-56b9-4066-81fc-c484161c3800 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:06.850410 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179c3f7-56b9-4066-81fc-c484161c3800 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:06.851780 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 377/759] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:05:06.857188 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1b68f-653e-431d-aa7a-7862d521d81a None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:06.857660 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1b68f-653e-431d-aa7a-7862d521d81a None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:06.857751 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1b68f-653e-431d-aa7a-7862d521d81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:06.877893 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-e3a1b68f-653e-431d-aa7a-7862d521d81a None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:05:06.879126 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-e3a1b68f-653e-431d-aa7a-7862d521d81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:05:06.956060 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 383/760] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:05:06 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:05:07.284927 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179c3f7-56b9-4066-81fc-c484161c3800 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:07.353232 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:07.389089 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179c3f7-56b9-4066-81fc-c484161c3800 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:07.428191 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11427a1-fe72-4c9d-9705-65e4cd5d8437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:07.428804 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11427a1-fe72-4c9d-9705-65e4cd5d8437 None admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:07.429080 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11427a1-fe72-4c9d-9705-65e4cd5d8437 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:07.429351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11427a1-fe72-4c9d-9705-65e4cd5d8437 None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:07.430049 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11427a1-fe72-4c9d-9705-65e4cd5d8437 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:07.431536 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11427a1-fe72-4c9d-9705-65e4cd5d8437 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:07.446562 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 378/761] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Sep 13 12:05:07 2022] POST /identity/v3/services => generated 269 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:05:08.763796 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3cb9d-2195-4e16-ae01-78c919848838 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:08.764322 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3cb9d-2195-4e16-ae01-78c919848838 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:08.764322 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3cb9d-2195-4e16-ae01-78c919848838 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:08.765648 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 384/762] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:05:08.771589 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e5a2f-f798-4557-b3c8-c6aec3ddd838 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:08.772040 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e5a2f-f798-4557-b3c8-c6aec3ddd838 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:08.772225 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e5a2f-f798-4557-b3c8-c6aec3ddd838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:08.791503 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-d72e5a2f-f798-4557-b3c8-c6aec3ddd838 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:05:08.792687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-d72e5a2f-f798-4557-b3c8-c6aec3ddd838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:05:08.867935 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 379/763] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:05:08 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:05:09.210656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3cb9d-2195-4e16-ae01-78c919848838 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:09.296976 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:09.348471 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3cb9d-2195-4e16-ae01-78c919848838 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:09.384685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb785dae-e8d0-4d82-b7f3-04802664b562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:09.385360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb785dae-e8d0-4d82-b7f3-04802664b562 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:09.385635 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb785dae-e8d0-4d82-b7f3-04802664b562 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:09.385904 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb785dae-e8d0-4d82-b7f3-04802664b562 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:09.386555 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb785dae-e8d0-4d82-b7f3-04802664b562 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:09.387940 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb785dae-e8d0-4d82-b7f3-04802664b562 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:09.403970 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 385/764] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Sep 13 12:05:09 2022] POST /identity/v3/services => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:05:09.924319 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e966a-c4ab-4402-9317-24ca8a1f511e None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:09.924851 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e966a-c4ab-4402-9317-24ca8a1f511e None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:09.924851 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e966a-c4ab-4402-9317-24ca8a1f511e None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:09.926170 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 380/765] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:05:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:05:09.932137 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecca93-92c7-41f7-aa84-665e06a81428 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:09.932621 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecca93-92c7-41f7-aa84-665e06a81428 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:09.932735 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecca93-92c7-41f7-aa84-665e06a81428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:09.951521 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-62ecca93-92c7-41f7-aa84-665e06a81428 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:05:09.952764 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-62ecca93-92c7-41f7-aa84-665e06a81428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:05:10.028203 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 386/766] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:05:09 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:05:10.359077 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e966a-c4ab-4402-9317-24ca8a1f511e None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:10.418827 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:10.479101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e966a-c4ab-4402-9317-24ca8a1f511e None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:10.523555 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0e68d-e3ed-406b-b280-c71b9d592114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:10.524198 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0e68d-e3ed-406b-b280-c71b9d592114 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:10.524480 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0e68d-e3ed-406b-b280-c71b9d592114 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:10.524753 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0e68d-e3ed-406b-b280-c71b9d592114 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:10.525346 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0e68d-e3ed-406b-b280-c71b9d592114 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:10.526759 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0e68d-e3ed-406b-b280-c71b9d592114 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:10.536551 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-4ad0e68d-e3ed-406b-b280-c71b9d592114 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:05:10.536551 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:10.536551 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:05:10.536551 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:05:10.536551 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:05:10.536551 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:05:10.536551 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:05:10.536551 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:05:10.536551 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:05:10.536551 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:10.536551 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:05:10.536551 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:10.536551 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:10.536551 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:05:10.536551 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:05:10.536551 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:05:10.537509 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:05:10.537509 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:05:10.537509 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:05:10.537509 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:05:10.537509 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:05:10.537509 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:05:10.537509 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:05:10.537509 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:05:10.537509 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:05:10.537509 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:05:10.537509 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:05:10.537509 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:05:10.537509 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:05:10.537509 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:05:10.537509 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:05:10.537509 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:05:10.537509 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:05:10.538409 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:05:10.538409 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:05:10.538409 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:05:10.538409 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:05:10.538409 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:05:10.538409 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:05:10.538409 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:05:10.538409 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:05:10.538409 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:05:10.538409 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:05:10.538409 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:05:10.538409 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:05:10.538409 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:05:10.538409 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:10.538409 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 381/767] 10.222.0.15 () {56 vars in 1132 bytes} [Tue Sep 13 12:05:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:05:10.543989 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecca93-92c7-41f7-aa84-665e06a81428 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:10.597512 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:10.679308 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecca93-92c7-41f7-aa84-665e06a81428 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:10.716271 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77573d-9682-4b24-9255-1f99eb4855ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:10.716884 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77573d-9682-4b24-9255-1f99eb4855ec None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:10.717162 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77573d-9682-4b24-9255-1f99eb4855ec None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:10.717433 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77573d-9682-4b24-9255-1f99eb4855ec None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:10.718075 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77573d-9682-4b24-9255-1f99eb4855ec None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:10.718377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77573d-9682-4b24-9255-1f99eb4855ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:10.719961 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77573d-9682-4b24-9255-1f99eb4855ec None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:10.725345 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 387/768] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Sep 13 12:05:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:10.730872 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0e68d-e3ed-406b-b280-c71b9d592114 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:10.833520 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0e68d-e3ed-406b-b280-c71b9d592114 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:10.849491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:10.871484 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141db6b-fef3-4f54-bf63-d2cdd5b7ccf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:10.872090 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141db6b-fef3-4f54-bf63-d2cdd5b7ccf5 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:10.872364 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141db6b-fef3-4f54-bf63-d2cdd5b7ccf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:10.872632 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141db6b-fef3-4f54-bf63-d2cdd5b7ccf5 None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:10.873281 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141db6b-fef3-4f54-bf63-d2cdd5b7ccf5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:10.873576 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141db6b-fef3-4f54-bf63-d2cdd5b7ccf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:10.874966 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141db6b-fef3-4f54-bf63-d2cdd5b7ccf5 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:10.881103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 382/769] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Sep 13 12:05:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:10.888532 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77573d-9682-4b24-9255-1f99eb4855ec None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:10.991245 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77573d-9682-4b24-9255-1f99eb4855ec None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:11.002193 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:11.028303 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886c086-5725-447a-940d-353560c32642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:11.028931 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886c086-5725-447a-940d-353560c32642 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:11.029205 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886c086-5725-447a-940d-353560c32642 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:11.029474 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886c086-5725-447a-940d-353560c32642 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:11.030184 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886c086-5725-447a-940d-353560c32642 None admin] RBAC: Adding query filter params (interface=public, service_id=edcfeae9f0ee4e459902529718b5d3f3, region_id=RegionOne) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:11.030488 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886c086-5725-447a-940d-353560c32642 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:11.031895 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886c086-5725-447a-940d-353560c32642 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:11.037425 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 388/770] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Sep 13 12:05:10 2022] GET /identity/v3/endpoints?service_id=edcfeae9f0ee4e459902529718b5d3f3&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:11.043586 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141db6b-fef3-4f54-bf63-d2cdd5b7ccf5 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:11.152704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141db6b-fef3-4f54-bf63-d2cdd5b7ccf5 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:11.187626 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e01c57-5264-47cf-b032-4eb222ad2044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:11.188943 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e01c57-5264-47cf-b032-4eb222ad2044 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:11.189331 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e01c57-5264-47cf-b032-4eb222ad2044 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:11.189612 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e01c57-5264-47cf-b032-4eb222ad2044 None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:11.190205 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e01c57-5264-47cf-b032-4eb222ad2044 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:11.191600 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e01c57-5264-47cf-b032-4eb222ad2044 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:11.197408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 383/771] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Sep 13 12:05:11 2022] GET /identity/v3/services => generated 1498 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:05:11.884925 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1567bf7-b307-4bdd-b1c8-42f874f85276 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:11.885208 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1567bf7-b307-4bdd-b1c8-42f874f85276 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:11.885487 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1567bf7-b307-4bdd-b1c8-42f874f85276 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:11.886855 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 389/772] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:05:11.892216 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b32506-a9d7-42a0-99a3-ddb48e8f5a99 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:11.892552 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b32506-a9d7-42a0-99a3-ddb48e8f5a99 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:11.892924 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b32506-a9d7-42a0-99a3-ddb48e8f5a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:11.910997 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-17b32506-a9d7-42a0-99a3-ddb48e8f5a99 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:05:11.912184 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-17b32506-a9d7-42a0-99a3-ddb48e8f5a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:05:11.952559 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:11.979248 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 384/773] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:05:11 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:05:12.308038 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1567bf7-b307-4bdd-b1c8-42f874f85276 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:12.421804 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1567bf7-b307-4bdd-b1c8-42f874f85276 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:12.468334 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b033c36-ec2b-4008-9a7e-0c129a32b930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:12.469693 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b033c36-ec2b-4008-9a7e-0c129a32b930 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:12.469983 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b033c36-ec2b-4008-9a7e-0c129a32b930 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:12.470259 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b033c36-ec2b-4008-9a7e-0c129a32b930 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:12.471103 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b033c36-ec2b-4008-9a7e-0c129a32b930 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:12.473309 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b033c36-ec2b-4008-9a7e-0c129a32b930 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:12.483055 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-0b033c36-ec2b-4008-9a7e-0c129a32b930 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:05:12.483055 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:12.483055 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:05:12.483055 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:05:12.483055 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:05:12.483055 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:05:12.483055 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:05:12.483055 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:05:12.483055 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:05:12.483055 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:12.483055 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:05:12.483055 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:12.483055 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:12.483055 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:05:12.483055 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:05:12.483055 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:05:12.483055 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:05:12.484100 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:05:12.484100 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:05:12.484100 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:05:12.484100 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:05:12.484100 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:05:12.484100 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:05:12.484100 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:05:12.484100 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:05:12.484100 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:05:12.484100 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:05:12.484100 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:05:12.484100 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:05:12.484100 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:05:12.484100 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:05:12.484100 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:05:12.484100 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:05:12.485749 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:05:12.485749 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:05:12.485749 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:05:12.485749 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:05:12.485749 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:05:12.485749 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:05:12.485749 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:05:12.485749 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:05:12.485749 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:05:12.485749 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:05:12.485749 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:05:12.485749 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:05:12.485749 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:05:12.485749 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:12.485749 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 390/774] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Sep 13 12:05:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:05:12.490765 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b32506-a9d7-42a0-99a3-ddb48e8f5a99 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:12.609301 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b32506-a9d7-42a0-99a3-ddb48e8f5a99 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:12.648249 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958db27-7228-4672-9671-f41e9e12e13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:12.648858 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958db27-7228-4672-9671-f41e9e12e13a None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:12.649135 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958db27-7228-4672-9671-f41e9e12e13a None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:12.649407 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958db27-7228-4672-9671-f41e9e12e13a None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:12.650039 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958db27-7228-4672-9671-f41e9e12e13a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:12.650341 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958db27-7228-4672-9671-f41e9e12e13a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:12.651740 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958db27-7228-4672-9671-f41e9e12e13a None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:12.656560 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 385/775] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Sep 13 12:05:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:12.663168 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b033c36-ec2b-4008-9a7e-0c129a32b930 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:12.699235 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:12.767649 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b033c36-ec2b-4008-9a7e-0c129a32b930 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:12.801941 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd57f3-0135-4d16-9753-1a60c8576d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:12.802543 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd57f3-0135-4d16-9753-1a60c8576d9c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:12.802848 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd57f3-0135-4d16-9753-1a60c8576d9c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:12.803117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd57f3-0135-4d16-9753-1a60c8576d9c None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:12.803750 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd57f3-0135-4d16-9753-1a60c8576d9c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:12.804057 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd57f3-0135-4d16-9753-1a60c8576d9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:12.805412 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd57f3-0135-4d16-9753-1a60c8576d9c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:12.810401 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 391/776] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Sep 13 12:05:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:12.816350 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958db27-7228-4672-9671-f41e9e12e13a None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:12.858669 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:12.920378 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958db27-7228-4672-9671-f41e9e12e13a None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:12.954877 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba20de-10e5-49f8-b565-1aec1a928427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:12.955483 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba20de-10e5-49f8-b565-1aec1a928427 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:12.955760 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba20de-10e5-49f8-b565-1aec1a928427 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:12.956029 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba20de-10e5-49f8-b565-1aec1a928427 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:12.956728 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba20de-10e5-49f8-b565-1aec1a928427 None admin] RBAC: Adding query filter params (interface=public, service_id=e1a3fe44b2364f85b85ce5e34f049201, region_id=RegionOne) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:12.957032 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba20de-10e5-49f8-b565-1aec1a928427 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:12.958389 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba20de-10e5-49f8-b565-1aec1a928427 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:12.965027 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 386/777] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Sep 13 12:05:12 2022] GET /identity/v3/endpoints?service_id=e1a3fe44b2364f85b85ce5e34f049201&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:12.970762 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd57f3-0135-4d16-9753-1a60c8576d9c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:13.069220 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:13.072790 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd57f3-0135-4d16-9753-1a60c8576d9c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:13.107288 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a335f-65fc-4bf5-9b74-7f3bdf373bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:13.107992 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a335f-65fc-4bf5-9b74-7f3bdf373bfa None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:13.108275 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a335f-65fc-4bf5-9b74-7f3bdf373bfa None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:13.108549 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a335f-65fc-4bf5-9b74-7f3bdf373bfa None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:13.109153 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a335f-65fc-4bf5-9b74-7f3bdf373bfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:13.110841 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a335f-65fc-4bf5-9b74-7f3bdf373bfa None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:13.126676 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 392/778] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Sep 13 12:05:12 2022] GET /identity/v3/services => generated 1498 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:05:13.653157 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04d15b-c1c9-4401-a167-21f48744a055 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:13.653714 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04d15b-c1c9-4401-a167-21f48744a055 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:13.653714 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04d15b-c1c9-4401-a167-21f48744a055 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:13.655046 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 387/779] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:05:13.660452 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6df58-3d09-4a76-8077-bfe2df12a3ee None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:13.660867 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6df58-3d09-4a76-8077-bfe2df12a3ee None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:13.661029 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6df58-3d09-4a76-8077-bfe2df12a3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:13.682097 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-82e6df58-3d09-4a76-8077-bfe2df12a3ee None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:05:13.683334 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-82e6df58-3d09-4a76-8077-bfe2df12a3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:05:13.757409 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 393/780] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:05:13 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:05:14.082747 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04d15b-c1c9-4401-a167-21f48744a055 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:14.186876 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04d15b-c1c9-4401-a167-21f48744a055 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:14.189010 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:14.229673 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5109847-4474-4d81-89b3-13e12246f3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:14.230294 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5109847-4474-4d81-89b3-13e12246f3c8 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:14.230567 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5109847-4474-4d81-89b3-13e12246f3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:14.230867 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5109847-4474-4d81-89b3-13e12246f3c8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:14.231440 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5109847-4474-4d81-89b3-13e12246f3c8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:14.232797 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5109847-4474-4d81-89b3-13e12246f3c8 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:14.242061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-b5109847-4474-4d81-89b3-13e12246f3c8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:05:14.242061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:14.242061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:05:14.242061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:05:14.242061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:05:14.242061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:05:14.242061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:05:14.242061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:05:14.242061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:05:14.242061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:14.242061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:05:14.242061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:14.242061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:14.242061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:05:14.242061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:05:14.242061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:05:14.243101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:05:14.243101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:05:14.243101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:05:14.243101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:05:14.243101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:05:14.243101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:05:14.243101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:05:14.243101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:05:14.243101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:05:14.243101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:05:14.243101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:05:14.243101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:05:14.243101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:05:14.243101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:05:14.243101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:05:14.243101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:05:14.243101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:05:14.244403 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:05:14.244403 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:05:14.244403 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:05:14.244403 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:05:14.244403 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:05:14.244403 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:05:14.244403 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:05:14.244403 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:05:14.244403 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:05:14.244403 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:05:14.244403 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:05:14.244403 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:05:14.244403 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 12:05:14.244403 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:14.244403 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 388/781] 10.222.0.15 () {56 vars in 1132 bytes} [Tue Sep 13 12:05:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:05:14.249361 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6df58-3d09-4a76-8077-bfe2df12a3ee None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:14.347817 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:14.355078 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6df58-3d09-4a76-8077-bfe2df12a3ee None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:14.390941 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58be917-8c3b-4664-ae1f-2e3cde2e86ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:14.391755 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58be917-8c3b-4664-ae1f-2e3cde2e86ae None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:14.392033 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58be917-8c3b-4664-ae1f-2e3cde2e86ae None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:14.392309 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58be917-8c3b-4664-ae1f-2e3cde2e86ae None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:14.392943 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58be917-8c3b-4664-ae1f-2e3cde2e86ae None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:14.393243 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58be917-8c3b-4664-ae1f-2e3cde2e86ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:14.394600 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58be917-8c3b-4664-ae1f-2e3cde2e86ae None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:14.399613 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 394/782] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Sep 13 12:05:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:14.405357 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5109847-4474-4d81-89b3-13e12246f3c8 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:14.510004 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5109847-4474-4d81-89b3-13e12246f3c8 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:14.556388 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc8b79-d884-418c-b8a9-1ac4fe20068e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:14.556991 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc8b79-d884-418c-b8a9-1ac4fe20068e None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:14.557265 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc8b79-d884-418c-b8a9-1ac4fe20068e None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:14.557538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc8b79-d884-418c-b8a9-1ac4fe20068e None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:14.558165 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc8b79-d884-418c-b8a9-1ac4fe20068e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:14.558468 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc8b79-d884-418c-b8a9-1ac4fe20068e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:14.559903 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc8b79-d884-418c-b8a9-1ac4fe20068e None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:14.564944 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 389/783] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Sep 13 12:05:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:05:14.570587 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58be917-8c3b-4664-ae1f-2e3cde2e86ae None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:14.678190 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58be917-8c3b-4664-ae1f-2e3cde2e86ae None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:14.713894 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39ec27-e79b-41da-af33-c65f31d8ce05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:14.714493 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39ec27-e79b-41da-af33-c65f31d8ce05 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:14.714796 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39ec27-e79b-41da-af33-c65f31d8ce05 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:14.715065 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39ec27-e79b-41da-af33-c65f31d8ce05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:14.715737 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39ec27-e79b-41da-af33-c65f31d8ce05 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:14.717087 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39ec27-e79b-41da-af33-c65f31d8ce05 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:14.738942 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 395/784] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Sep 13 12:05:14 2022] POST /identity/v3/endpoints => generated 347 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:05:15.571891 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7dfd7-54c8-482e-a550-169ce4652e83 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:15.572423 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7dfd7-54c8-482e-a550-169ce4652e83 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:15.572423 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7dfd7-54c8-482e-a550-169ce4652e83 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:15.573738 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 390/785] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:05:15.579639 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ada0a-6d36-43a2-a221-f48ed9065558 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:15.579924 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ada0a-6d36-43a2-a221-f48ed9065558 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:15.580201 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ada0a-6d36-43a2-a221-f48ed9065558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:15.598574 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-a57ada0a-6d36-43a2-a221-f48ed9065558 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:05:15.599786 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-a57ada0a-6d36-43a2-a221-f48ed9065558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:05:15.609003 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:15.677463 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 396/786] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:05:15 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:05:16.001657 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7dfd7-54c8-482e-a550-169ce4652e83 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:16.033403 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:16.107737 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7dfd7-54c8-482e-a550-169ce4652e83 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:16.143277 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9f156-f101-4dad-9937-2c01a3a6b318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:16.143908 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9f156-f101-4dad-9937-2c01a3a6b318 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:16.144179 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9f156-f101-4dad-9937-2c01a3a6b318 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:16.144447 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9f156-f101-4dad-9937-2c01a3a6b318 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:16.145028 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9f156-f101-4dad-9937-2c01a3a6b318 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:16.146394 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9f156-f101-4dad-9937-2c01a3a6b318 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:16.155569 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-e8f9f156-f101-4dad-9937-2c01a3a6b318 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:05:16.155569 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:16.155569 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:05:16.155569 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:05:16.155569 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:05:16.155569 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:05:16.155569 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:05:16.155569 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:05:16.155569 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:05:16.155569 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:16.155569 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:05:16.155569 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:16.155569 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:16.155569 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:05:16.155569 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:05:16.155569 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:05:16.155569 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:05:16.156605 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:05:16.156605 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:05:16.156605 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:05:16.156605 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:05:16.156605 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:05:16.156605 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:05:16.156605 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:05:16.156605 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:05:16.156605 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:05:16.156605 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:05:16.156605 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:05:16.156605 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:05:16.156605 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:05:16.156605 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:05:16.156605 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:05:16.156605 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:05:16.157479 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:05:16.157479 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:05:16.157479 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:05:16.157479 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:05:16.157479 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:05:16.157479 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:05:16.157479 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:05:16.157479 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:05:16.157479 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:05:16.157479 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:05:16.157479 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:05:16.157479 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:05:16.157479 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 12:05:16.157479 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:16.157479 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 391/787] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Sep 13 12:05:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:05:16.162715 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ada0a-6d36-43a2-a221-f48ed9065558 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:16.262053 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ada0a-6d36-43a2-a221-f48ed9065558 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:16.295618 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84306179-6c9b-41c2-85f3-0a640160f2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:16.296218 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84306179-6c9b-41c2-85f3-0a640160f2d8 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:16.296494 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84306179-6c9b-41c2-85f3-0a640160f2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:16.296764 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84306179-6c9b-41c2-85f3-0a640160f2d8 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:16.297929 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84306179-6c9b-41c2-85f3-0a640160f2d8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:16.298228 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84306179-6c9b-41c2-85f3-0a640160f2d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:16.299689 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84306179-6c9b-41c2-85f3-0a640160f2d8 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:16.304282 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 397/788] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Sep 13 12:05:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:16.309986 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9f156-f101-4dad-9937-2c01a3a6b318 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:16.402889 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:16.410017 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9f156-f101-4dad-9937-2c01a3a6b318 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:16.447240 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543d9f8-3335-42bd-9b57-aaa2e1d176c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:16.447839 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543d9f8-3335-42bd-9b57-aaa2e1d176c7 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:16.448114 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543d9f8-3335-42bd-9b57-aaa2e1d176c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:16.448382 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543d9f8-3335-42bd-9b57-aaa2e1d176c7 None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:16.449014 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543d9f8-3335-42bd-9b57-aaa2e1d176c7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:16.449316 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543d9f8-3335-42bd-9b57-aaa2e1d176c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:16.450687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543d9f8-3335-42bd-9b57-aaa2e1d176c7 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:16.455909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 392/789] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Sep 13 12:05:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:16.461756 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84306179-6c9b-41c2-85f3-0a640160f2d8 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:16.465690 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:16.561550 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84306179-6c9b-41c2-85f3-0a640160f2d8 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:16.595207 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96691077-4071-45a8-898b-6fe6ae0cbe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:16.595803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96691077-4071-45a8-898b-6fe6ae0cbe09 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:16.596076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96691077-4071-45a8-898b-6fe6ae0cbe09 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:16.596343 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96691077-4071-45a8-898b-6fe6ae0cbe09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:16.597130 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96691077-4071-45a8-898b-6fe6ae0cbe09 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:16.598356 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96691077-4071-45a8-898b-6fe6ae0cbe09 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:16.618971 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 398/790] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Sep 13 12:05:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:05:17.253290 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831768c-6159-47bb-b99b-4a3a9159016e None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:17.253821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831768c-6159-47bb-b99b-4a3a9159016e None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:17.253821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831768c-6159-47bb-b99b-4a3a9159016e None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:17.255166 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 393/791] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:05:17.260408 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82feed87-8e30-4d55-90e6-7a216de9f34f None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:17.260834 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82feed87-8e30-4d55-90e6-7a216de9f34f None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:17.261094 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82feed87-8e30-4d55-90e6-7a216de9f34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:17.279284 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-82feed87-8e30-4d55-90e6-7a216de9f34f None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:05:17.280462 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-82feed87-8e30-4d55-90e6-7a216de9f34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:05:17.336253 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:17.356425 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 399/792] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:05:17 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:05:17.681116 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831768c-6159-47bb-b99b-4a3a9159016e None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:17.787627 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831768c-6159-47bb-b99b-4a3a9159016e None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:17.822862 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586da06-5609-4269-8730-545eceec95a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:17.823486 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586da06-5609-4269-8730-545eceec95a8 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:17.823759 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586da06-5609-4269-8730-545eceec95a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:17.824026 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586da06-5609-4269-8730-545eceec95a8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:17.824603 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586da06-5609-4269-8730-545eceec95a8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:17.825967 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586da06-5609-4269-8730-545eceec95a8 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:17.835112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-9586da06-5609-4269-8730-545eceec95a8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:05:17.835112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:17.835112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:05:17.835112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:05:17.835112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:05:17.835112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:05:17.835112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:05:17.835112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:05:17.835112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:05:17.835112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:17.835112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:05:17.835112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:17.835112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:17.835112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:05:17.835112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:05:17.835112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:05:17.835112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:05:17.836256 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:05:17.836256 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:05:17.836256 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:05:17.836256 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:05:17.836256 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:05:17.836256 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:05:17.836256 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:05:17.836256 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:05:17.836256 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:05:17.836256 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:05:17.836256 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:05:17.836256 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:05:17.836256 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:05:17.836256 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:05:17.836256 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:05:17.836256 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:05:17.837145 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:05:17.837145 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:05:17.837145 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:05:17.837145 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:05:17.837145 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:05:17.837145 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:05:17.837145 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:05:17.837145 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:05:17.837145 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:05:17.837145 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:05:17.837145 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:05:17.837145 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:05:17.837145 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:05:17.837145 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:17.837145 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 394/793] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:05:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:05:17.842202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82feed87-8e30-4d55-90e6-7a216de9f34f None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:17.943110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82feed87-8e30-4d55-90e6-7a216de9f34f None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:17.976225 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f974e-0273-4a62-bb6c-4bf029feb67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:17.976822 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f974e-0273-4a62-bb6c-4bf029feb67e None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:17.977095 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f974e-0273-4a62-bb6c-4bf029feb67e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:17.977363 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f974e-0273-4a62-bb6c-4bf029feb67e None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:17.977993 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f974e-0273-4a62-bb6c-4bf029feb67e None admin] RBAC: Adding query filter params (name=compute) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:17.978288 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f974e-0273-4a62-bb6c-4bf029feb67e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:17.979677 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f974e-0273-4a62-bb6c-4bf029feb67e None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:17.984179 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 400/794] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Sep 13 12:05:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:17.990572 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586da06-5609-4269-8730-545eceec95a8 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:18.015796 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:18.097963 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586da06-5609-4269-8730-545eceec95a8 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:18.139341 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32061fd9-a67a-4f62-9f2e-e9b768bd03f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:18.139940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32061fd9-a67a-4f62-9f2e-e9b768bd03f2 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:18.140212 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32061fd9-a67a-4f62-9f2e-e9b768bd03f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:18.140480 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32061fd9-a67a-4f62-9f2e-e9b768bd03f2 None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:18.141196 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32061fd9-a67a-4f62-9f2e-e9b768bd03f2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:18.141711 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32061fd9-a67a-4f62-9f2e-e9b768bd03f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:18.143175 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32061fd9-a67a-4f62-9f2e-e9b768bd03f2 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:18.147990 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 395/795] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Sep 13 12:05:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:05:19.088276 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175bb30-8d2b-4b24-9e4f-7ac6bd91c3c8 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:19.088822 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175bb30-8d2b-4b24-9e4f-7ac6bd91c3c8 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:19.088822 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175bb30-8d2b-4b24-9e4f-7ac6bd91c3c8 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:19.090155 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 401/796] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:05:19.096216 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a86275-f2d4-415a-b69c-3cb14f7fb848 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:19.096647 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a86275-f2d4-415a-b69c-3cb14f7fb848 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:19.096773 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a86275-f2d4-415a-b69c-3cb14f7fb848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:19.115654 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-37a86275-f2d4-415a-b69c-3cb14f7fb848 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:05:19.116843 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-37a86275-f2d4-415a-b69c-3cb14f7fb848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:05:19.185894 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 396/797] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:05:19 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:05:19.509528 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175bb30-8d2b-4b24-9e4f-7ac6bd91c3c8 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:19.565857 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:19.617803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175bb30-8d2b-4b24-9e4f-7ac6bd91c3c8 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:19.655985 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db138d-d6f6-4f3b-bc08-2d13502cab94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:19.657201 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db138d-d6f6-4f3b-bc08-2d13502cab94 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:19.657481 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db138d-d6f6-4f3b-bc08-2d13502cab94 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:19.657750 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db138d-d6f6-4f3b-bc08-2d13502cab94 None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:19.658404 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db138d-d6f6-4f3b-bc08-2d13502cab94 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:19.659864 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db138d-d6f6-4f3b-bc08-2d13502cab94 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:19.662527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: WARNING keystone.server.flask.common [None req-47db138d-d6f6-4f3b-bc08-2d13502cab94 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 12:05:19.688361 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.sql.core [None req-47db138d-d6f6-4f3b-bc08-2d13502cab94 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 12:05:19.688361 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 12:05:19.688361 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [parameters: {'id': 'e4509a606e6f4d20adfd6ad76e745eae', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 12:05:19.688361 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88357) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 12:05:19.706360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-47db138d-d6f6-4f3b-bc08-2d13502cab94 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e4509a606e6f4d20adfd6ad76e745eae.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e4509a606e6f4d20adfd6ad76e745eae. Sep 13 12:05:19.706360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:19.706360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 12:05:19.706360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 12:05:19.706360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 12:05:19.706360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 12:05:19.706360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 12:05:19.706360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 12:05:19.706360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 12:05:19.706360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application conn.query(q) Sep 13 12:05:19.706360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 12:05:19.706360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 12:05:19.706360 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 12:05:19.707402 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application result.read() Sep 13 12:05:19.707402 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 12:05:19.707402 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 12:05:19.707402 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 12:05:19.707402 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 12:05:19.707402 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 12:05:19.707402 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 12:05:19.707402 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 12:05:19.707402 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 12:05:19.707402 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 12:05:19.707402 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:19.707402 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 12:05:19.707402 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:19.707402 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:19.707402 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 12:05:19.707402 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 12:05:19.707402 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 13 12:05:19.707402 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 13 12:05:19.708431 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 12:05:19.708431 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application next(self.gen) Sep 13 12:05:19.708431 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 12:05:19.708431 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application yield resource Sep 13 12:05:19.708431 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 12:05:19.708431 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application next(self.gen) Sep 13 12:05:19.708431 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 12:05:19.708431 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 12:05:19.708431 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 12:05:19.708431 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 12:05:19.708431 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 12:05:19.708431 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise self.value Sep 13 12:05:19.708431 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 12:05:19.708431 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 12:05:19.708431 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 12:05:19.708431 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application session.commit() Sep 13 12:05:19.708431 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 12:05:19.709346 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 12:05:19.709346 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 12:05:19.709346 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 12:05:19.709346 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 12:05:19.709346 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self.session.flush() Sep 13 12:05:19.709346 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 12:05:19.709346 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 12:05:19.709346 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 12:05:19.709346 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 12:05:19.709346 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 12:05:19.709346 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application compat.raise_( Sep 13 12:05:19.709346 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 12:05:19.709346 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception Sep 13 12:05:19.709346 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 12:05:19.709346 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 12:05:19.709346 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 12:05:19.709346 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 12:05:19.710278 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 12:05:19.710278 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 12:05:19.710278 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 12:05:19.710278 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 12:05:19.710278 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 12:05:19.710278 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 12:05:19.710278 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 12:05:19.710278 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 12:05:19.710278 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 12:05:19.710278 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 12:05:19.710278 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 12:05:19.710278 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 12:05:19.710278 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 12:05:19.710278 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 12:05:19.710278 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 12:05:19.711136 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 12:05:19.711136 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 12:05:19.711136 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception Sep 13 12:05:19.711136 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 12:05:19.711136 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 12:05:19.711136 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 12:05:19.711136 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 12:05:19.711136 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 12:05:19.711136 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 12:05:19.711136 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 12:05:19.711136 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application conn.query(q) Sep 13 12:05:19.711136 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 12:05:19.711136 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 12:05:19.711136 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 12:05:19.711136 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application result.read() Sep 13 12:05:19.711136 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 12:05:19.711136 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 12:05:19.712008 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 12:05:19.712008 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 12:05:19.712008 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 12:05:19.712008 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 12:05:19.712008 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 12:05:19.712008 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 12:05:19.712008 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 12:05:19.712008 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 12:05:19.712008 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [parameters: {'id': 'e4509a606e6f4d20adfd6ad76e745eae', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 12:05:19.712008 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 12:05:19.712008 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:19.712008 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:05:19.712008 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:19.712008 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:19.712008 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 13 12:05:19.714016 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 13 12:05:19.714016 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 12:05:19.714016 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 12:05:19.714016 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 13 12:05:19.714016 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:19.714016 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:05:19.714016 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:19.714016 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:19.714016 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:05:19.714016 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:05:19.714016 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:05:19.714016 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:05:19.714016 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:05:19.714016 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:05:19.714016 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:05:19.714016 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:05:19.714016 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:05:19.715253 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:05:19.715253 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 13 12:05:19.715253 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 13 12:05:19.715253 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:05:19.715253 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:05:19.715253 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 13 12:05:19.715253 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 13 12:05:19.715253 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e4509a606e6f4d20adfd6ad76e745eae. Sep 13 12:05:19.715253 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:19.715253 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 402/798] 10.222.0.15 () {60 vars in 1140 bytes} [Tue Sep 13 12:05:19 2022] POST /identity/v3/projects => generated 262 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:05:19.716041 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a86275-f2d4-415a-b69c-3cb14f7fb848 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:19.731575 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:19.821108 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a86275-f2d4-415a-b69c-3cb14f7fb848 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:19.856006 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d7d97-d2ab-402d-bd52-3a6456b1221c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:19.856633 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d7d97-d2ab-402d-bd52-3a6456b1221c None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:19.856911 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d7d97-d2ab-402d-bd52-3a6456b1221c None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:19.857185 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d7d97-d2ab-402d-bd52-3a6456b1221c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:19.864366 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d7d97-d2ab-402d-bd52-3a6456b1221c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:19.865798 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d7d97-d2ab-402d-bd52-3a6456b1221c None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:19.877177 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-180d7d97-d2ab-402d-bd52-3a6456b1221c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:05:19.877177 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:19.877177 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:05:19.877177 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:05:19.877177 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:05:19.877177 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:05:19.877177 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:05:19.877177 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:05:19.877177 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:05:19.877177 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:05:19.877177 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:05:19.877177 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:05:19.877177 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:05:19.877177 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:05:19.877177 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:05:19.878343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:05:19.878343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:05:19.878343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:05:19.878343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:05:19.878343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:05:19.878343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:05:19.878343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:05:19.878343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:05:19.878343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:05:19.878343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:05:19.878343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:05:19.878343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:05:19.878343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:05:19.878343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:05:19.878343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:05:19.878343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:05:19.878343 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:05:19.879416 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:05:19.879416 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:05:19.879416 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:05:19.879416 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:05:19.879416 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:05:19.879416 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:05:19.879416 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:05:19.879416 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:19.879416 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 397/799] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:05:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:05:19.884299 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db138d-d6f6-4f3b-bc08-2d13502cab94 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:19.985961 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db138d-d6f6-4f3b-bc08-2d13502cab94 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:19.993062 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:20.021445 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a77bc-fc5c-4556-a9c3-78dfa31a96a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:20.022040 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a77bc-fc5c-4556-a9c3-78dfa31a96a0 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:20.022312 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a77bc-fc5c-4556-a9c3-78dfa31a96a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:20.022576 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a77bc-fc5c-4556-a9c3-78dfa31a96a0 None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:20.023271 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a77bc-fc5c-4556-a9c3-78dfa31a96a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:20.023569 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a77bc-fc5c-4556-a9c3-78dfa31a96a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:20.025191 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a77bc-fc5c-4556-a9c3-78dfa31a96a0 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:20.050651 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 403/800] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Sep 13 12:05:19 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:20.605376 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61299d8-f4c8-49ff-8074-3d587ae1a935 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:20.605911 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61299d8-f4c8-49ff-8074-3d587ae1a935 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:20.605911 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61299d8-f4c8-49ff-8074-3d587ae1a935 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:20.607263 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 398/801] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:05:20.613476 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b96bb2-4dd0-47a9-948d-8ef519a63a66 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:20.613938 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b96bb2-4dd0-47a9-948d-8ef519a63a66 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:20.614027 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b96bb2-4dd0-47a9-948d-8ef519a63a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:20.632964 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-c9b96bb2-4dd0-47a9-948d-8ef519a63a66 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:05:20.634473 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-c9b96bb2-4dd0-47a9-948d-8ef519a63a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:05:20.705637 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 404/802] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:05:20 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:05:21.030704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61299d8-f4c8-49ff-8074-3d587ae1a935 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:21.110393 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:21.135380 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61299d8-f4c8-49ff-8074-3d587ae1a935 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:21.170776 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526489a-45c1-4948-84f3-58ddfe75e1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:21.171376 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526489a-45c1-4948-84f3-58ddfe75e1d3 None admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:21.171654 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526489a-45c1-4948-84f3-58ddfe75e1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:21.171925 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526489a-45c1-4948-84f3-58ddfe75e1d3 None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:21.172607 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526489a-45c1-4948-84f3-58ddfe75e1d3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:21.173970 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526489a-45c1-4948-84f3-58ddfe75e1d3 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:21.189198 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 399/803] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Sep 13 12:05:21 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:05:22.563889 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d8359-6974-400a-a131-9f9c61aeeca7 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:22.563889 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d8359-6974-400a-a131-9f9c61aeeca7 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:22.563889 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d8359-6974-400a-a131-9f9c61aeeca7 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:22.566687 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 405/804] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:05:22.570851 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca06a78-bbe6-494e-8bab-44cae083b515 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:22.571284 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca06a78-bbe6-494e-8bab-44cae083b515 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:22.571475 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca06a78-bbe6-494e-8bab-44cae083b515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:22.590904 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-0ca06a78-bbe6-494e-8bab-44cae083b515 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:05:22.592111 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-0ca06a78-bbe6-494e-8bab-44cae083b515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:05:22.670709 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 400/805] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:05:22 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:05:22.995341 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d8359-6974-400a-a131-9f9c61aeeca7 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:23.091090 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:23.098481 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d8359-6974-400a-a131-9f9c61aeeca7 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:23.135650 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18eece4-3f72-4915-9c73-202521cc39c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:23.136256 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18eece4-3f72-4915-9c73-202521cc39c9 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:23.136529 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18eece4-3f72-4915-9c73-202521cc39c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:23.136799 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18eece4-3f72-4915-9c73-202521cc39c9 None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:23.137447 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18eece4-3f72-4915-9c73-202521cc39c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:23.138891 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18eece4-3f72-4915-9c73-202521cc39c9 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:23.153297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.sql.core [None req-a18eece4-3f72-4915-9c73-202521cc39c9 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 12:05:23.153297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 12:05:23.153297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [parameters: {'user_id': 'dec13a32b76340a58e39bbb56355bbec', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 12:05:23.153297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88357) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 12:05:23.159842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-a18eece4-3f72-4915-9c73-202521cc39c9 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 12:05:23.159842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:23.159842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 12:05:23.159842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 12:05:23.159842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 12:05:23.159842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 12:05:23.159842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 12:05:23.159842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 12:05:23.159842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 12:05:23.159842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application conn.query(q) Sep 13 12:05:23.159842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 12:05:23.159842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 12:05:23.159842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 12:05:23.159842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application result.read() Sep 13 12:05:23.159842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 12:05:23.160914 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 12:05:23.160914 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 12:05:23.160914 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 12:05:23.160914 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 12:05:23.160914 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 12:05:23.160914 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 12:05:23.160914 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 12:05:23.160914 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 12:05:23.160914 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:23.160914 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 12:05:23.160914 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:23.160914 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:23.160914 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 12:05:23.160914 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 12:05:23.160914 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 13 12:05:23.160914 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 13 12:05:23.160914 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 12:05:23.160914 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application next(self.gen) Sep 13 12:05:23.162191 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 12:05:23.162191 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application yield resource Sep 13 12:05:23.162191 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 12:05:23.162191 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application next(self.gen) Sep 13 12:05:23.162191 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 12:05:23.162191 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 12:05:23.162191 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 12:05:23.162191 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 12:05:23.162191 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 12:05:23.162191 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise self.value Sep 13 12:05:23.162191 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 12:05:23.162191 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 12:05:23.162191 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 12:05:23.162191 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application session.commit() Sep 13 12:05:23.162191 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 12:05:23.162191 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 12:05:23.162191 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 12:05:23.163539 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 12:05:23.163539 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 12:05:23.163539 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self.session.flush() Sep 13 12:05:23.163539 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 12:05:23.163539 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 12:05:23.163539 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 12:05:23.163539 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 12:05:23.163539 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 12:05:23.163539 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application compat.raise_( Sep 13 12:05:23.163539 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 12:05:23.163539 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception Sep 13 12:05:23.163539 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 12:05:23.163539 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 12:05:23.163539 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 12:05:23.163539 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 12:05:23.163539 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 12:05:23.163539 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 12:05:23.164644 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 12:05:23.164644 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 12:05:23.164644 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 13 12:05:23.164644 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 13 12:05:23.164644 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 12:05:23.164644 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 12:05:23.164644 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 12:05:23.164644 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 12:05:23.164644 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 12:05:23.164644 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 12:05:23.164644 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 12:05:23.164644 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 12:05:23.164644 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 12:05:23.164644 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 12:05:23.164644 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 12:05:23.164644 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception Sep 13 12:05:23.166434 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 12:05:23.166434 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 12:05:23.166434 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 12:05:23.166434 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 12:05:23.166434 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 12:05:23.166434 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 12:05:23.166434 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 12:05:23.166434 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application conn.query(q) Sep 13 12:05:23.166434 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 12:05:23.166434 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 12:05:23.166434 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 12:05:23.166434 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application result.read() Sep 13 12:05:23.166434 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 12:05:23.166434 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 12:05:23.166434 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 12:05:23.166434 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 12:05:23.167560 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 12:05:23.167560 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 12:05:23.167560 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 12:05:23.167560 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 12:05:23.167560 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 12:05:23.167560 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 12:05:23.167560 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [parameters: {'user_id': 'dec13a32b76340a58e39bbb56355bbec', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 12:05:23.167560 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 12:05:23.167560 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:23.167560 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:05:23.167560 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:23.167560 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:23.167560 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:05:23.167560 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:05:23.167560 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:05:23.168626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:05:23.168626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:05:23.168626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:05:23.168626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:05:23.168626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:05:23.168626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:05:23.168626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:05:23.168626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 13 12:05:23.168626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 13 12:05:23.168626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:05:23.168626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:05:23.168626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:05:23.168626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:05:23.168626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:05:23.168626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:05:23.168626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 13 12:05:23.168626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 13 12:05:23.170080 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 13 12:05:23.170080 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 13 12:05:23.170080 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 12:05:23.170080 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 12:05:23.170080 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 12:05:23.170080 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:23.170080 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 406/806] 10.222.0.15 () {60 vars in 1131 bytes} [Tue Sep 13 12:05:22 2022] POST /identity/v3/users => generated 160 bytes in 166 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:05:23.171618 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca06a78-bbe6-494e-8bab-44cae083b515 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:23.233564 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:23.275835 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca06a78-bbe6-494e-8bab-44cae083b515 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:23.310595 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c334bc-76dd-4a15-97dd-36c49ffd50e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:23.311281 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c334bc-76dd-4a15-97dd-36c49ffd50e7 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:23.311562 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c334bc-76dd-4a15-97dd-36c49ffd50e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:23.311836 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c334bc-76dd-4a15-97dd-36c49ffd50e7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:23.320624 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c334bc-76dd-4a15-97dd-36c49ffd50e7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:23.322106 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c334bc-76dd-4a15-97dd-36c49ffd50e7 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:23.334684 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-34c334bc-76dd-4a15-97dd-36c49ffd50e7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 12:05:23.334684 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:23.334684 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:05:23.334684 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:05:23.334684 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:05:23.334684 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:05:23.334684 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:05:23.334684 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:05:23.334684 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:05:23.334684 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:05:23.334684 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:05:23.334684 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:05:23.334684 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:05:23.334684 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:05:23.334684 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:05:23.334684 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:05:23.335909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:05:23.335909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:05:23.335909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:05:23.335909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:05:23.335909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:05:23.335909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:05:23.335909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:05:23.335909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:05:23.335909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:05:23.335909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:05:23.335909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:05:23.335909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:05:23.335909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:05:23.335909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:05:23.335909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:05:23.335909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:05:23.335909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:05:23.335909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:05:23.337314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:05:23.337314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:05:23.337314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:05:23.337314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:05:23.337314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:05:23.337314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:05:23.337314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:05:23.337314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:05:23.337314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 12:05:23.337314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:23.338757 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 401/807] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:05:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:05:23.341707 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18eece4-3f72-4915-9c73-202521cc39c9 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:23.442625 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18eece4-3f72-4915-9c73-202521cc39c9 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:23.477124 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4f8e0-4437-46cf-9a29-068eee1bcfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:23.477756 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4f8e0-4437-46cf-9a29-068eee1bcfbc None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:23.478029 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4f8e0-4437-46cf-9a29-068eee1bcfbc None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:23.478297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4f8e0-4437-46cf-9a29-068eee1bcfbc None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:23.479020 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4f8e0-4437-46cf-9a29-068eee1bcfbc None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:23.479320 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4f8e0-4437-46cf-9a29-068eee1bcfbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:23.480933 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4f8e0-4437-46cf-9a29-068eee1bcfbc None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:23.518486 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 407/808] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Sep 13 12:05:23 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:23.639184 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dccb28-3434-46a7-b759-0bd2211dd83e None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:23.639724 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dccb28-3434-46a7-b759-0bd2211dd83e None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:23.639724 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dccb28-3434-46a7-b759-0bd2211dd83e None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:23.641412 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 402/809] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:05:23.650652 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a52be4-c3e7-49ab-bed3-1c55007dc24d None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:23.650652 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a52be4-c3e7-49ab-bed3-1c55007dc24d None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:23.650652 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a52be4-c3e7-49ab-bed3-1c55007dc24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:23.675912 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-d7a52be4-c3e7-49ab-bed3-1c55007dc24d None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:05:23.677493 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-d7a52be4-c3e7-49ab-bed3-1c55007dc24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:05:23.691655 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:23.758695 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 408/810] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:05:23 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:05:24.088365 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dccb28-3434-46a7-b759-0bd2211dd83e None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:24.190858 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dccb28-3434-46a7-b759-0bd2211dd83e None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:24.213320 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:24.225252 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ba796-cb9e-4a7b-be28-33cd0c47063b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:24.225866 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ba796-cb9e-4a7b-be28-33cd0c47063b None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:24.226143 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ba796-cb9e-4a7b-be28-33cd0c47063b None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:24.226414 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ba796-cb9e-4a7b-be28-33cd0c47063b None admin] PATH_INFO: `/v3/services/compute` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:24.227019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ba796-cb9e-4a7b-be28-33cd0c47063b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:24.228378 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ba796-cb9e-4a7b-be28-33cd0c47063b None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:24.237190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-192ba796-cb9e-4a7b-be28-33cd0c47063b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:05:24.237190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:24.237190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:05:24.237190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:05:24.237190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:05:24.237190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:05:24.237190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:05:24.237190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:05:24.237190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:05:24.237190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:24.237190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:05:24.237190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:24.237190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:24.237190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:05:24.237190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:05:24.237190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:05:24.237190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:05:24.238408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:05:24.238408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:05:24.238408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:05:24.238408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:05:24.238408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:05:24.238408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:05:24.238408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:05:24.238408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:05:24.238408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:05:24.238408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:05:24.238408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:05:24.238408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:05:24.238408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:05:24.238408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:05:24.238408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:05:24.238408 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:05:24.239497 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:05:24.239497 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:05:24.239497 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:05:24.239497 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:05:24.239497 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:05:24.239497 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:05:24.239497 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:05:24.239497 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:05:24.239497 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:05:24.239497 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:05:24.239497 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:05:24.239497 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:05:24.239497 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:05:24.239497 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:05:24.239497 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 403/811] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:05:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:05:24.244544 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a52be4-c3e7-49ab-bed3-1c55007dc24d None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:24.342298 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a52be4-c3e7-49ab-bed3-1c55007dc24d None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:24.375852 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05df7b-9eb8-4437-8d0a-c10c91666858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:24.376531 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05df7b-9eb8-4437-8d0a-c10c91666858 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:24.376864 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05df7b-9eb8-4437-8d0a-c10c91666858 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:24.377134 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05df7b-9eb8-4437-8d0a-c10c91666858 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:24.377759 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05df7b-9eb8-4437-8d0a-c10c91666858 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:24.378059 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05df7b-9eb8-4437-8d0a-c10c91666858 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:24.379482 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05df7b-9eb8-4437-8d0a-c10c91666858 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:24.384230 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 409/812] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Sep 13 12:05:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:24.389967 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ba796-cb9e-4a7b-be28-33cd0c47063b None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:24.489528 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ba796-cb9e-4a7b-be28-33cd0c47063b None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:24.525081 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5128994-a39f-41bc-b3c5-06412facc97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:24.525738 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5128994-a39f-41bc-b3c5-06412facc97a None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:24.526011 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5128994-a39f-41bc-b3c5-06412facc97a None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:24.526279 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5128994-a39f-41bc-b3c5-06412facc97a None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:24.526943 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5128994-a39f-41bc-b3c5-06412facc97a None admin] RBAC: Adding query filter params (type=compute) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:24.527239 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5128994-a39f-41bc-b3c5-06412facc97a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:24.528603 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5128994-a39f-41bc-b3c5-06412facc97a None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:24.533858 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 404/813] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Sep 13 12:05:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:24.541907 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05df7b-9eb8-4437-8d0a-c10c91666858 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:24.557131 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:24.648599 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05df7b-9eb8-4437-8d0a-c10c91666858 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:24.688432 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1157c-0a6f-4256-8772-8e7d96c66d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:24.689110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1157c-0a6f-4256-8772-8e7d96c66d7f None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:24.689343 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1157c-0a6f-4256-8772-8e7d96c66d7f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:24.689609 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1157c-0a6f-4256-8772-8e7d96c66d7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:24.690309 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1157c-0a6f-4256-8772-8e7d96c66d7f None admin] RBAC: Adding query filter params (interface=public, service_id=b1f6003f3be5419fa48c4a13be4605c8, region_id=RegionOne) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:24.690639 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1157c-0a6f-4256-8772-8e7d96c66d7f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:24.691986 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1157c-0a6f-4256-8772-8e7d96c66d7f None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:24.697357 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 410/814] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Sep 13 12:05:24 2022] GET /identity/v3/endpoints?service_id=b1f6003f3be5419fa48c4a13be4605c8&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:24.703719 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5128994-a39f-41bc-b3c5-06412facc97a None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:24.754529 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:24.806003 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5128994-a39f-41bc-b3c5-06412facc97a None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:24.840704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a100f-e4dc-4066-8e05-d3934ddf3ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:24.841305 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a100f-e4dc-4066-8e05-d3934ddf3ce2 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:24.841585 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a100f-e4dc-4066-8e05-d3934ddf3ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:24.841858 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a100f-e4dc-4066-8e05-d3934ddf3ce2 None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:24.842472 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a100f-e4dc-4066-8e05-d3934ddf3ce2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:24.844015 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a100f-e4dc-4066-8e05-d3934ddf3ce2 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:24.851125 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 405/815] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Sep 13 12:05:24 2022] GET /identity/v3/services => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:05:27.284144 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad1b0e-097a-4d31-94c4-932a1dd59372 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:27.284713 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad1b0e-097a-4d31-94c4-932a1dd59372 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:27.284713 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad1b0e-097a-4d31-94c4-932a1dd59372 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:27.285996 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 411/816] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:05:27.291740 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebfedf-53a1-45f8-8921-58d24f032aa3 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:27.292165 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebfedf-53a1-45f8-8921-58d24f032aa3 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:27.292291 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebfedf-53a1-45f8-8921-58d24f032aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:27.311361 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-dfebfedf-53a1-45f8-8921-58d24f032aa3 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:05:27.312580 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-dfebfedf-53a1-45f8-8921-58d24f032aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:05:27.379736 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 406/817] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:05:27 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:05:27.719951 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad1b0e-097a-4d31-94c4-932a1dd59372 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:27.802129 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:27.828860 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad1b0e-097a-4d31-94c4-932a1dd59372 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:27.865020 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb2372-3823-4261-b997-4576d7213bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:27.865645 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb2372-3823-4261-b997-4576d7213bd5 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:27.865918 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb2372-3823-4261-b997-4576d7213bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:27.866187 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb2372-3823-4261-b997-4576d7213bd5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:27.866796 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb2372-3823-4261-b997-4576d7213bd5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:27.868150 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb2372-3823-4261-b997-4576d7213bd5 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:27.879410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-01cb2372-3823-4261-b997-4576d7213bd5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:05:27.879410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:27.879410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:05:27.879410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:05:27.879410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:05:27.879410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:05:27.879410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:05:27.879410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:05:27.879410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:05:27.879410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:27.879410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:05:27.879410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:27.879410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:05:27.879410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:05:27.879410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:05:27.879410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:05:27.879410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:05:27.880638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:05:27.880638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:05:27.880638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:05:27.880638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:05:27.880638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:05:27.880638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:05:27.880638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:05:27.880638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:05:27.880638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:05:27.880638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:05:27.880638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:05:27.880638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:05:27.880638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:05:27.880638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:05:27.880638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:05:27.880638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:05:27.881533 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:05:27.881533 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:05:27.881533 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:05:27.881533 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:05:27.881533 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:05:27.881533 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:05:27.881533 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:05:27.881533 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:05:27.881533 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:05:27.881533 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:05:27.881533 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:05:27.881533 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:05:27.881533 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 12:05:27.881533 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:05:27.881533 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 412/818] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:05:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:05:27.886602 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfebfedf-53a1-45f8-8921-58d24f032aa3 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:27.935135 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:27.990630 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfebfedf-53a1-45f8-8921-58d24f032aa3 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:28.026254 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f0834-b20f-4eb3-accd-a2b2f3e54e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:28.026896 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f0834-b20f-4eb3-accd-a2b2f3e54e14 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:28.027179 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f0834-b20f-4eb3-accd-a2b2f3e54e14 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:28.027449 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f0834-b20f-4eb3-accd-a2b2f3e54e14 None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:28.028114 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f0834-b20f-4eb3-accd-a2b2f3e54e14 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:28.028418 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f0834-b20f-4eb3-accd-a2b2f3e54e14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:28.029806 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f0834-b20f-4eb3-accd-a2b2f3e54e14 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:28.035059 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 407/819] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Sep 13 12:05:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:28.040902 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb2372-3823-4261-b997-4576d7213bd5 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:28.145184 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb2372-3823-4261-b997-4576d7213bd5 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:28.180408 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4420ad6-971d-4cd2-9748-9321afdb8851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:28.181015 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4420ad6-971d-4cd2-9748-9321afdb8851 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:28.181292 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4420ad6-971d-4cd2-9748-9321afdb8851 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:28.181595 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4420ad6-971d-4cd2-9748-9321afdb8851 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:28.182229 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4420ad6-971d-4cd2-9748-9321afdb8851 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:05:28.182531 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4420ad6-971d-4cd2-9748-9321afdb8851 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:28.183921 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4420ad6-971d-4cd2-9748-9321afdb8851 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:28.191270 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 413/820] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Sep 13 12:05:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:05:28.196992 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f0834-b20f-4eb3-accd-a2b2f3e54e14 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:05:28.304557 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f0834-b20f-4eb3-accd-a2b2f3e54e14 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:05:28.314946 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:28.340286 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c07603-9e56-44b7-b472-2d16bdc94d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:05:28.340884 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c07603-9e56-44b7-b472-2d16bdc94d85 None admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:05:28.341160 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c07603-9e56-44b7-b472-2d16bdc94d85 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:05:28.341431 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c07603-9e56-44b7-b472-2d16bdc94d85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:05:28.342099 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c07603-9e56-44b7-b472-2d16bdc94d85 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:05:28.343495 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c07603-9e56-44b7-b472-2d16bdc94d85 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:05:28.366376 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 408/821] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Sep 13 12:05:28 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:05:38.187406 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:05:38.362306 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=17,keystone:INSERT=1 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:33.472997 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b7a53-200f-4484-8274-35eeb7489671 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:33.473606 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b7a53-200f-4484-8274-35eeb7489671 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:33.473606 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b7a53-200f-4484-8274-35eeb7489671 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:33.475134 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 414/822] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:06:33.481559 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ad8eb-b7f2-46b4-aa99-5396d617032d None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:33.482135 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ad8eb-b7f2-46b4-aa99-5396d617032d None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:33.482135 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ad8eb-b7f2-46b4-aa99-5396d617032d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:33.505919 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-439ad8eb-b7f2-46b4-aa99-5396d617032d None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:06:33.507629 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-439ad8eb-b7f2-46b4-aa99-5396d617032d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:06:33.609756 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 409/823] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:06:33 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:06:34.038318 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b7a53-200f-4484-8274-35eeb7489671 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:34.192646 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b7a53-200f-4484-8274-35eeb7489671 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:34.239948 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8a525-ebdd-4e61-87bb-25d6ea046694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:34.240983 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8a525-ebdd-4e61-87bb-25d6ea046694 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:34.241326 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8a525-ebdd-4e61-87bb-25d6ea046694 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:34.241774 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8a525-ebdd-4e61-87bb-25d6ea046694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:34.259286 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8a525-ebdd-4e61-87bb-25d6ea046694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:34.261341 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8a525-ebdd-4e61-87bb-25d6ea046694 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:34.282685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-11a8a525-ebdd-4e61-87bb-25d6ea046694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:34.282685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:34.282685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:34.282685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:34.282685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:34.282685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:34.282685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:34.282685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:34.282685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:34.282685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:34.282685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:34.282685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:34.282685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:06:34.282685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:06:34.282685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:06:34.282685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:06:34.283987 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:34.283987 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:34.283987 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:34.283987 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:34.283987 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:34.283987 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:34.283987 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:34.283987 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:34.283987 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:34.283987 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:34.283987 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:34.283987 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:34.283987 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:34.283987 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:34.283987 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:34.283987 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:34.283987 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:06:34.285106 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:06:34.285106 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:34.285106 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:06:34.285106 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 415/824] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:34.292289 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ad8eb-b7f2-46b4-aa99-5396d617032d None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:34.433622 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ad8eb-b7f2-46b4-aa99-5396d617032d None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:34.467422 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:34.480706 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ce8bd-71f2-48c3-bb57-25736f58cba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:34.481363 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ce8bd-71f2-48c3-bb57-25736f58cba3 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:34.482202 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ce8bd-71f2-48c3-bb57-25736f58cba3 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:34.482861 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ce8bd-71f2-48c3-bb57-25736f58cba3 None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:34.483259 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ce8bd-71f2-48c3-bb57-25736f58cba3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:34.483565 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ce8bd-71f2-48c3-bb57-25736f58cba3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:34.485023 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ce8bd-71f2-48c3-bb57-25736f58cba3 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:34.501633 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 410/825] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:34.507529 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8a525-ebdd-4e61-87bb-25d6ea046694 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:34.570776 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:34.628110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8a525-ebdd-4e61-87bb-25d6ea046694 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:34.670189 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc0452-f262-4752-82d9-78209ffcf3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:34.670908 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc0452-f262-4752-82d9-78209ffcf3fe None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:34.671274 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc0452-f262-4752-82d9-78209ffcf3fe None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:34.671540 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc0452-f262-4752-82d9-78209ffcf3fe None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:34.672190 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc0452-f262-4752-82d9-78209ffcf3fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:34.673655 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc0452-f262-4752-82d9-78209ffcf3fe None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:34.695704 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 416/826] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Sep 13 12:06:34 2022] POST /identity/v3/users => generated 251 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:06:37.222486 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3197d-73bb-4b00-87ac-a8998e1cef99 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:37.223066 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3197d-73bb-4b00-87ac-a8998e1cef99 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:37.223066 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3197d-73bb-4b00-87ac-a8998e1cef99 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:37.224376 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 411/827] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:06:37.229779 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b10da0-c8c2-443a-ab4c-665de83dc84e None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:37.230252 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b10da0-c8c2-443a-ab4c-665de83dc84e None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:37.230352 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b10da0-c8c2-443a-ab4c-665de83dc84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:37.251871 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-a9b10da0-c8c2-443a-ab4c-665de83dc84e None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:06:37.253084 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-a9b10da0-c8c2-443a-ab4c-665de83dc84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:06:37.324326 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 417/828] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:06:37 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:06:37.654171 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3197d-73bb-4b00-87ac-a8998e1cef99 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:37.772047 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3197d-73bb-4b00-87ac-a8998e1cef99 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:37.811428 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554028e-4897-41ba-ae23-30a9bbd92fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:37.812051 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554028e-4897-41ba-ae23-30a9bbd92fb7 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:37.812330 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554028e-4897-41ba-ae23-30a9bbd92fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:37.812604 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554028e-4897-41ba-ae23-30a9bbd92fb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:37.824436 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554028e-4897-41ba-ae23-30a9bbd92fb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:06:37.829993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-7554028e-4897-41ba-ae23-30a9bbd92fb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:06:37.829993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:37.829993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:37.829993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:37.829993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:37.829993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:37.829993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:37.829993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:37.829993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:37.829993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:37.829993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:37.829993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:37.829993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:06:37.829993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:06:37.829993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:06:37.829993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:06:37.831372 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:06:37.831372 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:06:37.831372 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:06:37.831372 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:06:37.831372 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:37.831372 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:37.831372 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:37.831372 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:37.831372 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:37.831372 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:37.831372 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:37.831372 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:37.831372 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:37.831372 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:37.831372 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:37.831372 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:37.832217 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:37.832217 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:37.832217 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:37.832217 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:37.832217 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:06:37.832217 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:06:37.832217 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:06:37.832217 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:06:37.832217 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:06:37.832217 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:06:37.832217 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:06:37.832217 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:06:37.832217 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 412/829] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Sep 13 12:06:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:37.837766 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b10da0-c8c2-443a-ab4c-665de83dc84e None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:37.881729 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:37.948733 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b10da0-c8c2-443a-ab4c-665de83dc84e None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:37.986930 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cecaa2-a1aa-48b1-9c74-342a93c66e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:37.987550 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cecaa2-a1aa-48b1-9c74-342a93c66e3a None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:37.987836 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cecaa2-a1aa-48b1-9c74-342a93c66e3a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:37.988120 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cecaa2-a1aa-48b1-9c74-342a93c66e3a None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:37.988886 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cecaa2-a1aa-48b1-9c74-342a93c66e3a None admin] RBAC: Adding query filter params (name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:37.989299 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cecaa2-a1aa-48b1-9c74-342a93c66e3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:37.990906 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cecaa2-a1aa-48b1-9c74-342a93c66e3a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:38.000571 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 418/830] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Sep 13 12:06:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:38.006851 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554028e-4897-41ba-ae23-30a9bbd92fb7 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:38.059997 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:38.125910 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554028e-4897-41ba-ae23-30a9bbd92fb7 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:38.166821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1dcf1-1010-44a4-9394-1bce5518d72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:38.167453 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1dcf1-1010-44a4-9394-1bce5518d72f None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:38.167730 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1dcf1-1010-44a4-9394-1bce5518d72f None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:38.168002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1dcf1-1010-44a4-9394-1bce5518d72f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:38.182720 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1dcf1-1010-44a4-9394-1bce5518d72f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:38.184927 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1dcf1-1010-44a4-9394-1bce5518d72f None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:38.203942 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-5cd1dcf1-1010-44a4-9394-1bce5518d72f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:38.203942 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:38.203942 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:38.203942 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:38.203942 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:38.203942 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:38.203942 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:38.203942 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:38.203942 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:38.203942 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:38.203942 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:38.203942 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:38.203942 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:06:38.203942 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:06:38.203942 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:06:38.203942 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:06:38.205132 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:38.205132 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:38.205132 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:38.205132 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:38.205132 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:38.205132 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:38.205132 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:38.205132 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:38.205132 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:38.205132 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:38.205132 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:38.205132 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:38.205132 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:38.205132 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:38.205132 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:38.205132 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:38.205132 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:06:38.206108 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:06:38.206108 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:38.206108 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:06:38.206108 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 413/831] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:38.211075 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cecaa2-a1aa-48b1-9c74-342a93c66e3a None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:38.329124 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:38.332500 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cecaa2-a1aa-48b1-9c74-342a93c66e3a None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:38.370165 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa25ba-3a8b-4117-87de-c520a852d378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:38.370812 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa25ba-3a8b-4117-87de-c520a852d378 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:38.371097 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa25ba-3a8b-4117-87de-c520a852d378 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:38.371373 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa25ba-3a8b-4117-87de-c520a852d378 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:38.372585 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa25ba-3a8b-4117-87de-c520a852d378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:38.372893 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa25ba-3a8b-4117-87de-c520a852d378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:38.374275 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa25ba-3a8b-4117-87de-c520a852d378 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:38.388512 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 419/832] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:38.394345 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1dcf1-1010-44a4-9394-1bce5518d72f None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:38.507526 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:38.511339 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1dcf1-1010-44a4-9394-1bce5518d72f None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:38.556349 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9614f-fcb8-48fc-932b-fa0aa2e11904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:38.557068 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9614f-fcb8-48fc-932b-fa0aa2e11904 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:38.557415 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9614f-fcb8-48fc-932b-fa0aa2e11904 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:38.557723 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9614f-fcb8-48fc-932b-fa0aa2e11904 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:38.566070 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9614f-fcb8-48fc-932b-fa0aa2e11904 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:38.567704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9614f-fcb8-48fc-932b-fa0aa2e11904 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:38.580812 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-e5d9614f-fcb8-48fc-932b-fa0aa2e11904 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:06:38.580812 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:38.580812 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:38.580812 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:38.580812 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:38.580812 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:38.580812 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:38.580812 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:38.580812 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:38.580812 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:38.580812 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:38.580812 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:38.580812 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:06:38.580812 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:06:38.580812 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:06:38.580812 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:06:38.582853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:38.582853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:38.582853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:06:38.582853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:06:38.582853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:06:38.582853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:06:38.582853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:38.582853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:38.582853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:38.582853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:38.582853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:38.582853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:38.582853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:38.582853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:38.582853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:38.582853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:38.582853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:38.582853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:38.584691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:38.584691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:38.584691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:06:38.584691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:06:38.584691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:06:38.584691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:06:38.584691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:06:38.584691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:06:38.584691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:06:38.584691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:06:38.584691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 414/833] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:38.587791 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa25ba-3a8b-4117-87de-c520a852d378 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:38.708716 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa25ba-3a8b-4117-87de-c520a852d378 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:38.751127 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4776641-7c5d-4950-a461-af238e76da9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:38.751970 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4776641-7c5d-4950-a461-af238e76da9b None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:38.752410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4776641-7c5d-4950-a461-af238e76da9b None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:38.752778 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4776641-7c5d-4950-a461-af238e76da9b None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:38.753825 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4776641-7c5d-4950-a461-af238e76da9b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:38.754282 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4776641-7c5d-4950-a461-af238e76da9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:38.755908 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4776641-7c5d-4950-a461-af238e76da9b None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:38.780019 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 420/834] 10.222.0.15 () {56 vars in 1143 bytes} [Tue Sep 13 12:06:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:38.785760 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9614f-fcb8-48fc-932b-fa0aa2e11904 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:38.901943 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9614f-fcb8-48fc-932b-fa0aa2e11904 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:38.936546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9effda94-26fe-48b9-8fb4-49c01a887f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:38.937151 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effda94-26fe-48b9-8fb4-49c01a887f69 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:38.937430 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effda94-26fe-48b9-8fb4-49c01a887f69 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:38.937700 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effda94-26fe-48b9-8fb4-49c01a887f69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:38.966459 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:39.011818 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9effda94-26fe-48b9-8fb4-49c01a887f69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:39.014000 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9effda94-26fe-48b9-8fb4-49c01a887f69 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:39.131984 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 415/835] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:06:38 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:06:39.138627 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4776641-7c5d-4950-a461-af238e76da9b None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:39.159578 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:39.245820 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4776641-7c5d-4950-a461-af238e76da9b None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:39.284638 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c6eaa-f71f-4d4b-be4c-4d4e0484ff9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:39.285252 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c6eaa-f71f-4d4b-be4c-4d4e0484ff9a None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:39.285530 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c6eaa-f71f-4d4b-be4c-4d4e0484ff9a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:39.285799 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c6eaa-f71f-4d4b-be4c-4d4e0484ff9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:39.297724 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c6eaa-f71f-4d4b-be4c-4d4e0484ff9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:39.299262 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c6eaa-f71f-4d4b-be4c-4d4e0484ff9a None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:39.314787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-b59c6eaa-f71f-4d4b-be4c-4d4e0484ff9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:39.314787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:39.314787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:39.314787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:39.314787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:39.314787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:39.314787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:39.314787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:39.314787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:39.314787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:39.314787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:39.314787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:39.314787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:06:39.314787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:06:39.314787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:06:39.314787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:06:39.315986 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:39.315986 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:39.315986 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:39.315986 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:39.315986 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:39.315986 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:39.315986 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:39.315986 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:39.315986 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:39.315986 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:39.315986 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:39.315986 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:39.315986 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:39.315986 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:39.315986 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:39.315986 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:39.315986 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:06:39.316907 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:06:39.316907 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:39.316907 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:06:39.316907 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 421/836] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:39.322022 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9effda94-26fe-48b9-8fb4-49c01a887f69 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:39.386111 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:39.438252 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9effda94-26fe-48b9-8fb4-49c01a887f69 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:39.476196 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc2192-8d44-48d5-8511-88cc259a46aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:39.476853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc2192-8d44-48d5-8511-88cc259a46aa None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:39.477137 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc2192-8d44-48d5-8511-88cc259a46aa None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:39.477409 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc2192-8d44-48d5-8511-88cc259a46aa None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:39.478103 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc2192-8d44-48d5-8511-88cc259a46aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:39.478407 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc2192-8d44-48d5-8511-88cc259a46aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:39.479935 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc2192-8d44-48d5-8511-88cc259a46aa None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:39.493835 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 416/837] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:39.500784 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c6eaa-f71f-4d4b-be4c-4d4e0484ff9a None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:39.589907 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:39.629522 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c6eaa-f71f-4d4b-be4c-4d4e0484ff9a None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:39.678219 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfedcd5-1213-4387-8258-3b01684bd433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:39.679069 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfedcd5-1213-4387-8258-3b01684bd433 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:39.679354 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfedcd5-1213-4387-8258-3b01684bd433 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:39.679618 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfedcd5-1213-4387-8258-3b01684bd433 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:39.688036 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfedcd5-1213-4387-8258-3b01684bd433 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:39.689666 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfedcd5-1213-4387-8258-3b01684bd433 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:39.705517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-0dfedcd5-1213-4387-8258-3b01684bd433 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:06:39.705517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:39.705517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:39.705517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:39.705517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:39.705517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:39.705517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:39.705517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:39.705517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:39.705517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:39.705517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:39.705517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:39.705517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:06:39.705517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:06:39.705517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:06:39.706887 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:06:39.706887 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:39.706887 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:39.706887 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:39.706887 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:39.706887 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:39.706887 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:39.706887 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:39.706887 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:39.706887 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:39.706887 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:39.706887 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:39.706887 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:39.706887 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:39.706887 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:39.706887 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:39.706887 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:39.708168 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:06:39.708168 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:06:39.708168 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:06:39.708168 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:06:39.708168 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:06:39.708168 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:06:39.708168 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:06:39.708168 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:06:39.708168 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 422/838] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:06:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:06:39.715647 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc2192-8d44-48d5-8511-88cc259a46aa None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:39.855153 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc2192-8d44-48d5-8511-88cc259a46aa None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:39.877913 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:39.902109 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f209e-da49-4e3f-bae1-60ebb054c3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:39.903680 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f209e-da49-4e3f-bae1-60ebb054c3dd None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:39.903680 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f209e-da49-4e3f-bae1-60ebb054c3dd None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:39.904482 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f209e-da49-4e3f-bae1-60ebb054c3dd None admin] PATH_INFO: `/v3/projects` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:39.905320 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f209e-da49-4e3f-bae1-60ebb054c3dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:39.905630 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f209e-da49-4e3f-bae1-60ebb054c3dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:39.907196 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f209e-da49-4e3f-bae1-60ebb054c3dd None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:39.923005 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 417/839] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Sep 13 12:06:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:06:39.931277 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfedcd5-1213-4387-8258-3b01684bd433 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:40.063522 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfedcd5-1213-4387-8258-3b01684bd433 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:40.102326 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:40.112396 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3a2e0-ccaa-40a0-a0aa-e55c7851875e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:40.113061 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3a2e0-ccaa-40a0-a0aa-e55c7851875e None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:40.113339 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3a2e0-ccaa-40a0-a0aa-e55c7851875e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:40.113608 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3a2e0-ccaa-40a0-a0aa-e55c7851875e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:40.114350 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3a2e0-ccaa-40a0-a0aa-e55c7851875e None admin] RBAC: Adding query filter params (role.id=45922c768b6541549cc7b4aa2d49b0ac, scope.project.id=2cd599a81e8043bebfca960673e63bbc, user.id=e72796c5d7864bd8887419c60e3bbc1b) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:40.114685 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3a2e0-ccaa-40a0-a0aa-e55c7851875e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:40.116195 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3a2e0-ccaa-40a0-a0aa-e55c7851875e None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:40.122512 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 423/840] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:06:39 2022] GET /identity/v3/role_assignments?user.id=e72796c5d7864bd8887419c60e3bbc1b&scope.project.id=2cd599a81e8043bebfca960673e63bbc&role.id=45922c768b6541549cc7b4aa2d49b0ac => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:42.718268 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bacf4-7258-4cb2-b0b7-33ee763ebc75 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:42.718927 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bacf4-7258-4cb2-b0b7-33ee763ebc75 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:42.718927 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bacf4-7258-4cb2-b0b7-33ee763ebc75 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:42.720237 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 418/841] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:06:42.726199 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc577ad7-f230-4d2e-9cc3-deb003cf642c None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:42.726838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc577ad7-f230-4d2e-9cc3-deb003cf642c None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:42.726838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc577ad7-f230-4d2e-9cc3-deb003cf642c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:42.748027 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-fc577ad7-f230-4d2e-9cc3-deb003cf642c None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:06:42.749244 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-fc577ad7-f230-4d2e-9cc3-deb003cf642c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:06:42.827781 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 424/842] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:06:42 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:06:43.180744 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bacf4-7258-4cb2-b0b7-33ee763ebc75 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:43.293117 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bacf4-7258-4cb2-b0b7-33ee763ebc75 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:43.329758 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433dcdb-a934-4632-a80a-5b63deb81cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:43.330380 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433dcdb-a934-4632-a80a-5b63deb81cc2 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:43.330683 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433dcdb-a934-4632-a80a-5b63deb81cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:43.331044 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433dcdb-a934-4632-a80a-5b63deb81cc2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:43.342057 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433dcdb-a934-4632-a80a-5b63deb81cc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:06:43.347419 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-a433dcdb-a934-4632-a80a-5b63deb81cc2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:06:43.347419 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:43.347419 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:43.347419 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:43.347419 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:43.347419 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:43.347419 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:43.347419 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:43.347419 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:43.347419 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:43.347419 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:43.347419 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:43.347419 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:06:43.347419 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:06:43.347419 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:06:43.347419 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:06:43.350940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:06:43.350940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:06:43.350940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:06:43.350940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:06:43.350940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:43.350940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:43.350940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:43.350940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:43.350940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:43.350940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:43.350940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:43.350940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:43.350940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:43.350940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:43.350940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:43.350940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:43.352815 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:43.352815 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:43.352815 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:43.352815 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:43.352815 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:06:43.352815 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:06:43.352815 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:06:43.352815 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:06:43.352815 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:06:43.352815 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:06:43.352815 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:06:43.352815 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:06:43.352815 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 419/843] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Sep 13 12:06:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:43.358473 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc577ad7-f230-4d2e-9cc3-deb003cf642c None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:43.468545 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc577ad7-f230-4d2e-9cc3-deb003cf642c None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:43.496934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:43.509443 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f5120-4844-47be-bd1a-9f2940a22e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:43.510051 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f5120-4844-47be-bd1a-9f2940a22e1e None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:43.510346 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f5120-4844-47be-bd1a-9f2940a22e1e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:43.510628 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f5120-4844-47be-bd1a-9f2940a22e1e None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:43.511294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f5120-4844-47be-bd1a-9f2940a22e1e None admin] RBAC: Adding query filter params (name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:43.511598 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f5120-4844-47be-bd1a-9f2940a22e1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:43.513596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f5120-4844-47be-bd1a-9f2940a22e1e None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:43.522779 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 425/844] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Sep 13 12:06:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:43.529959 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433dcdb-a934-4632-a80a-5b63deb81cc2 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:43.574050 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:43.640675 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433dcdb-a934-4632-a80a-5b63deb81cc2 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:43.678356 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc6204-cfee-44aa-bafc-3792080ec244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:43.679014 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc6204-cfee-44aa-bafc-3792080ec244 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:43.679289 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc6204-cfee-44aa-bafc-3792080ec244 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:43.679558 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc6204-cfee-44aa-bafc-3792080ec244 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:43.689708 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc6204-cfee-44aa-bafc-3792080ec244 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:43.691194 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc6204-cfee-44aa-bafc-3792080ec244 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:43.706753 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-c4cc6204-cfee-44aa-bafc-3792080ec244 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:43.706753 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:43.706753 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:43.706753 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:43.706753 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:43.706753 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:43.706753 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:43.706753 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:43.706753 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:43.706753 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:43.706753 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:43.706753 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:43.706753 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:06:43.706753 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:06:43.706753 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:06:43.706753 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:06:43.707920 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:43.707920 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:43.707920 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:43.707920 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:43.707920 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:43.707920 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:43.707920 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:43.707920 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:43.707920 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:43.707920 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:43.707920 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:43.707920 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:43.707920 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:43.707920 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:43.707920 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:43.707920 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:43.707920 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:06:43.709116 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:06:43.709116 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:43.709116 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:06:43.709116 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 420/845] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:06:43.713826 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f5120-4844-47be-bd1a-9f2940a22e1e None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:43.832627 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f5120-4844-47be-bd1a-9f2940a22e1e None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:43.869647 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b699f1-0c6a-4516-aa97-64a1b99d961f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:43.870273 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b699f1-0c6a-4516-aa97-64a1b99d961f None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:43.870532 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b699f1-0c6a-4516-aa97-64a1b99d961f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:43.870870 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b699f1-0c6a-4516-aa97-64a1b99d961f None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:43.872066 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b699f1-0c6a-4516-aa97-64a1b99d961f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:43.872371 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b699f1-0c6a-4516-aa97-64a1b99d961f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:43.873853 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b699f1-0c6a-4516-aa97-64a1b99d961f None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:43.887581 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 426/846] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:06:43.893664 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc6204-cfee-44aa-bafc-3792080ec244 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:44.002214 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:44.013458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc6204-cfee-44aa-bafc-3792080ec244 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:44.050031 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2956fa-daf8-4fc5-9e13-0c3fd48a6af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:44.050693 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2956fa-daf8-4fc5-9e13-0c3fd48a6af3 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:44.050962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2956fa-daf8-4fc5-9e13-0c3fd48a6af3 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:44.051236 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2956fa-daf8-4fc5-9e13-0c3fd48a6af3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:44.058671 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2956fa-daf8-4fc5-9e13-0c3fd48a6af3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:44.060205 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2956fa-daf8-4fc5-9e13-0c3fd48a6af3 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:44.071523 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-8c2956fa-daf8-4fc5-9e13-0c3fd48a6af3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:06:44.071523 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:44.071523 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:44.071523 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:44.071523 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:44.071523 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:44.071523 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:44.071523 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:44.071523 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:44.071523 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:44.071523 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:44.071523 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:44.071523 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:06:44.071523 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:06:44.071523 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:06:44.071523 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:06:44.072856 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:44.072856 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:44.072856 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:06:44.072856 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:06:44.072856 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:06:44.072856 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:06:44.072856 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:44.072856 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:44.072856 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:44.072856 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:44.072856 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:44.072856 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:44.072856 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:44.072856 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:44.072856 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:44.072856 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:44.072856 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:44.072856 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:44.074061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:44.074061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:44.074061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:06:44.074061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:06:44.074061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:06:44.074061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:06:44.074061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:06:44.074061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:06:44.074061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:06:44.074061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:06:44.074061 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 421/847] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:44.079108 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b699f1-0c6a-4516-aa97-64a1b99d961f None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:44.129923 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:44.187767 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b699f1-0c6a-4516-aa97-64a1b99d961f None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:44.225588 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713d892-306a-4fb7-a41c-44be9b1c760c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:44.226191 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713d892-306a-4fb7-a41c-44be9b1c760c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:44.226478 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713d892-306a-4fb7-a41c-44be9b1c760c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:44.226787 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713d892-306a-4fb7-a41c-44be9b1c760c None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:44.227582 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713d892-306a-4fb7-a41c-44be9b1c760c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:44.227887 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713d892-306a-4fb7-a41c-44be9b1c760c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:44.229304 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713d892-306a-4fb7-a41c-44be9b1c760c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:44.246858 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 427/848] 10.222.0.15 () {56 vars in 1143 bytes} [Tue Sep 13 12:06:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:06:44.252755 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2956fa-daf8-4fc5-9e13-0c3fd48a6af3 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:44.373907 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2956fa-daf8-4fc5-9e13-0c3fd48a6af3 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:44.410578 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d352ca-99c1-4efb-9eee-3fc0dad78afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:44.411157 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d352ca-99c1-4efb-9eee-3fc0dad78afc None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:44.411430 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d352ca-99c1-4efb-9eee-3fc0dad78afc None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:44.411700 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d352ca-99c1-4efb-9eee-3fc0dad78afc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:44.423538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d352ca-99c1-4efb-9eee-3fc0dad78afc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:44.424987 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d352ca-99c1-4efb-9eee-3fc0dad78afc None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:44.440411 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-68d352ca-99c1-4efb-9eee-3fc0dad78afc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:44.440411 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:44.440411 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:44.440411 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:44.440411 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:44.440411 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:44.440411 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:44.440411 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:44.440411 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:44.440411 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:44.440411 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:44.440411 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:44.440411 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:06:44.440411 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:06:44.440411 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:06:44.440411 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:06:44.441512 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:44.441512 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:44.441512 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:44.441512 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:44.441512 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:44.441512 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:44.441512 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:44.441512 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:44.441512 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:44.441512 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:44.441512 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:44.441512 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:44.441512 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:44.441512 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:44.441512 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:44.441512 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:44.441512 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:06:44.447373 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:06:44.447373 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:44.447373 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:06:44.447373 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 422/849] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:06:44.447658 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713d892-306a-4fb7-a41c-44be9b1c760c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:44.552510 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713d892-306a-4fb7-a41c-44be9b1c760c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:44.555210 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:44.589555 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c5978-0e0d-4792-b148-aa0d86492a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:44.591189 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c5978-0e0d-4792-b148-aa0d86492a66 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:44.591721 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c5978-0e0d-4792-b148-aa0d86492a66 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:44.592150 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c5978-0e0d-4792-b148-aa0d86492a66 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:44.593322 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c5978-0e0d-4792-b148-aa0d86492a66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:44.593859 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c5978-0e0d-4792-b148-aa0d86492a66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:44.595847 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c5978-0e0d-4792-b148-aa0d86492a66 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:44.609022 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 428/850] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:44.614820 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d352ca-99c1-4efb-9eee-3fc0dad78afc None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:44.617847 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:44.734885 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d352ca-99c1-4efb-9eee-3fc0dad78afc None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:44.772035 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd8cbd-59aa-4107-b388-ec81bca7d59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:44.772787 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd8cbd-59aa-4107-b388-ec81bca7d59e None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:44.773077 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd8cbd-59aa-4107-b388-ec81bca7d59e None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:44.773353 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd8cbd-59aa-4107-b388-ec81bca7d59e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:44.782295 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd8cbd-59aa-4107-b388-ec81bca7d59e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:44.783836 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd8cbd-59aa-4107-b388-ec81bca7d59e None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:44.799325 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-24cd8cbd-59aa-4107-b388-ec81bca7d59e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:06:44.799325 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:44.799325 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:44.799325 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:44.799325 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:44.799325 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:44.799325 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:44.799325 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:44.799325 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:44.799325 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:44.799325 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:44.799325 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:44.799325 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:06:44.799325 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:06:44.799325 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:06:44.800438 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:06:44.800438 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:44.800438 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:44.800438 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:44.800438 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:44.800438 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:44.800438 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:44.800438 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:44.800438 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:44.800438 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:44.800438 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:44.800438 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:44.800438 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:44.800438 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:44.800438 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:44.800438 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:44.800438 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:44.801336 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:06:44.801336 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:06:44.801336 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:06:44.801336 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:06:44.801336 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:06:44.801336 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:06:44.801336 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:06:44.801336 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:06:44.801336 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 423/851] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:06:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:44.807020 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c5978-0e0d-4792-b148-aa0d86492a66 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:44.925130 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c5978-0e0d-4792-b148-aa0d86492a66 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:44.961883 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea9427-1ee4-4cce-b422-6e4be31a0eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:44.962493 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea9427-1ee4-4cce-b422-6e4be31a0eec None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:44.962799 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea9427-1ee4-4cce-b422-6e4be31a0eec None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:44.963067 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea9427-1ee4-4cce-b422-6e4be31a0eec None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:44.963753 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea9427-1ee4-4cce-b422-6e4be31a0eec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:44.964117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea9427-1ee4-4cce-b422-6e4be31a0eec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:44.966088 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea9427-1ee4-4cce-b422-6e4be31a0eec None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:44.980044 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 429/852] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Sep 13 12:06:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:44.986761 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd8cbd-59aa-4107-b388-ec81bca7d59e None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:45.052778 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:45.098597 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd8cbd-59aa-4107-b388-ec81bca7d59e None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:45.135425 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2700091-f7d8-4eb7-9b87-258852f4fd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:45.136113 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2700091-f7d8-4eb7-9b87-258852f4fd4e None admin] REQUEST_METHOD: `PUT` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:45.136361 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2700091-f7d8-4eb7-9b87-258852f4fd4e None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:45.136679 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2700091-f7d8-4eb7-9b87-258852f4fd4e None admin] PATH_INFO: `/v3/projects/2cd599a81e8043bebfca960673e63bbc/users/e72796c5d7864bd8887419c60e3bbc1b/roles/45922c768b6541549cc7b4aa2d49b0ac` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:45.151997 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2700091-f7d8-4eb7-9b87-258852f4fd4e None admin] RBAC: Authorizing `identity:create_grant(project_id=2cd599a81e8043bebfca960673e63bbc, user_id=e72796c5d7864bd8887419c60e3bbc1b, role_id=45922c768b6541549cc7b4aa2d49b0ac)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:45.153465 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2700091-f7d8-4eb7-9b87-258852f4fd4e None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:45.167112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 424/853] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Sep 13 12:06:44 2022] PUT /identity/v3/projects/2cd599a81e8043bebfca960673e63bbc/users/e72796c5d7864bd8887419c60e3bbc1b/roles/45922c768b6541549cc7b4aa2d49b0ac => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:06:47.749253 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367b670-4891-476c-8a28-6171cf96c685 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:47.749802 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367b670-4891-476c-8a28-6171cf96c685 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:47.749802 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367b670-4891-476c-8a28-6171cf96c685 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:47.751235 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 430/854] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:06:47.757053 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed0025-44be-4cc6-8930-51aaf12b0c18 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:47.757540 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed0025-44be-4cc6-8930-51aaf12b0c18 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:47.757651 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed0025-44be-4cc6-8930-51aaf12b0c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:47.779816 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-14ed0025-44be-4cc6-8930-51aaf12b0c18 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:06:47.781328 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-14ed0025-44be-4cc6-8930-51aaf12b0c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:06:47.869996 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 425/855] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:06:47 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:06:48.195320 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367b670-4891-476c-8a28-6171cf96c685 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:48.226081 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:48.326557 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367b670-4891-476c-8a28-6171cf96c685 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:48.372059 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8df38-2f86-433f-9308-b0d53e355bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:48.372700 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8df38-2f86-433f-9308-b0d53e355bb0 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:48.372984 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8df38-2f86-433f-9308-b0d53e355bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:48.373265 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8df38-2f86-433f-9308-b0d53e355bb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:48.387184 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8df38-2f86-433f-9308-b0d53e355bb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:06:48.392071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-13a8df38-2f86-433f-9308-b0d53e355bb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:06:48.392071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:48.392071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:48.392071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:48.392071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:48.392071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:48.392071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:48.392071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:48.392071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:48.392071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:48.392071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:48.392071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:48.392071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:06:48.392071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:06:48.392071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:06:48.392071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:06:48.393998 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:06:48.393998 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:06:48.393998 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:06:48.393998 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:06:48.393998 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:48.393998 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:48.393998 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:48.393998 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:48.393998 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:48.393998 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:48.393998 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:48.393998 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:48.393998 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:48.393998 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:48.393998 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:48.393998 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:48.396255 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:48.396255 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:48.396255 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:48.396255 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:48.396255 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:06:48.396255 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:06:48.396255 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:06:48.396255 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:06:48.396255 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:06:48.396255 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:06:48.396255 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 12:06:48.396255 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:06:48.396255 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 431/856] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Sep 13 12:06:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:48.401565 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed0025-44be-4cc6-8930-51aaf12b0c18 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:48.454690 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:48.522210 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed0025-44be-4cc6-8930-51aaf12b0c18 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:48.561302 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d0430-ffcf-4dc9-8965-06f6c80e940a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:48.561997 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d0430-ffcf-4dc9-8965-06f6c80e940a None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:48.562309 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d0430-ffcf-4dc9-8965-06f6c80e940a None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:48.562657 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d0430-ffcf-4dc9-8965-06f6c80e940a None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:48.563508 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d0430-ffcf-4dc9-8965-06f6c80e940a None admin] RBAC: Adding query filter params (name=service) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:48.563821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d0430-ffcf-4dc9-8965-06f6c80e940a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:48.565486 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d0430-ffcf-4dc9-8965-06f6c80e940a None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:48.578698 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 426/857] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Sep 13 12:06:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:48.582975 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8df38-2f86-433f-9308-b0d53e355bb0 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:48.694129 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:48.717339 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8df38-2f86-433f-9308-b0d53e355bb0 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:48.763988 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a01663-3616-4b62-8b12-695f615ca9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:48.765110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a01663-3616-4b62-8b12-695f615ca9e2 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:48.765450 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a01663-3616-4b62-8b12-695f615ca9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:48.765751 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a01663-3616-4b62-8b12-695f615ca9e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:48.777866 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a01663-3616-4b62-8b12-695f615ca9e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:48.779394 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a01663-3616-4b62-8b12-695f615ca9e2 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:48.796835 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-73a01663-3616-4b62-8b12-695f615ca9e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:48.796835 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:48.796835 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:48.796835 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:48.796835 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:48.796835 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:48.796835 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:48.796835 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:48.796835 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:48.796835 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:48.796835 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:48.796835 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:48.796835 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:06:48.796835 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:06:48.796835 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:06:48.796835 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:06:48.797999 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:48.797999 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:48.797999 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:48.797999 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:48.797999 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:48.797999 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:48.797999 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:48.797999 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:48.797999 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:48.797999 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:48.797999 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:48.797999 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:48.797999 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:48.797999 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:48.797999 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:48.797999 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:48.797999 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:06:48.799147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:06:48.799147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:48.799147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:06:48.799147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 432/858] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:48.804648 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d0430-ffcf-4dc9-8965-06f6c80e940a None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:48.926845 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d0430-ffcf-4dc9-8965-06f6c80e940a None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:48.929229 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:48.965377 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf694e7-4df5-4f2c-be1e-cae334b8dcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:48.965960 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf694e7-4df5-4f2c-be1e-cae334b8dcc8 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:48.966239 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf694e7-4df5-4f2c-be1e-cae334b8dcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:48.966510 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf694e7-4df5-4f2c-be1e-cae334b8dcc8 None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:48.967190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf694e7-4df5-4f2c-be1e-cae334b8dcc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:48.967538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf694e7-4df5-4f2c-be1e-cae334b8dcc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:48.968864 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf694e7-4df5-4f2c-be1e-cae334b8dcc8 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:48.982216 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 427/859] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:48.989523 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a01663-3616-4b62-8b12-695f615ca9e2 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:49.101430 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a01663-3616-4b62-8b12-695f615ca9e2 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:49.141598 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce89971-b0e5-472d-a294-9a4233bf90a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:49.142241 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce89971-b0e5-472d-a294-9a4233bf90a9 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:49.142522 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce89971-b0e5-472d-a294-9a4233bf90a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:49.142830 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce89971-b0e5-472d-a294-9a4233bf90a9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:49.145966 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:49.153672 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce89971-b0e5-472d-a294-9a4233bf90a9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:49.155522 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce89971-b0e5-472d-a294-9a4233bf90a9 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:49.170231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-fce89971-b0e5-472d-a294-9a4233bf90a9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:06:49.170231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:49.170231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:49.170231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:49.170231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:49.170231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:49.170231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:49.170231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:49.170231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:49.170231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:49.170231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:49.170231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:49.170231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:06:49.170231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:06:49.170231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:06:49.170231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:06:49.171444 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:49.171444 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:49.171444 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:06:49.171444 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:06:49.171444 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:06:49.171444 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:06:49.171444 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:49.171444 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:49.171444 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:49.171444 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:49.171444 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:49.171444 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:49.171444 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:49.171444 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:49.171444 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:49.171444 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:49.171444 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:49.171444 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:49.172524 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:49.172524 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:49.172524 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:06:49.172524 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:06:49.172524 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:06:49.172524 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:06:49.172524 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:06:49.172524 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:06:49.172524 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:06:49.172524 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:06:49.172524 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 433/860] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:49.178418 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf694e7-4df5-4f2c-be1e-cae334b8dcc8 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:49.304219 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf694e7-4df5-4f2c-be1e-cae334b8dcc8 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:49.348721 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c2c51-3566-40ee-b9bd-567d6ac8ef6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:49.349419 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c2c51-3566-40ee-b9bd-567d6ac8ef6b None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:49.349762 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c2c51-3566-40ee-b9bd-567d6ac8ef6b None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:49.350063 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c2c51-3566-40ee-b9bd-567d6ac8ef6b None admin] PATH_INFO: `/v3/users` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:49.351158 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c2c51-3566-40ee-b9bd-567d6ac8ef6b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:49.351470 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c2c51-3566-40ee-b9bd-567d6ac8ef6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:49.353146 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c2c51-3566-40ee-b9bd-567d6ac8ef6b None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:49.373665 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 428/861] 10.222.0.15 () {56 vars in 1143 bytes} [Tue Sep 13 12:06:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:49.380313 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce89971-b0e5-472d-a294-9a4233bf90a9 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:49.501236 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce89971-b0e5-472d-a294-9a4233bf90a9 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:49.541620 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d5f94-846f-4084-b367-bab2992ecacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:49.542243 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d5f94-846f-4084-b367-bab2992ecacc None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:49.543049 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d5f94-846f-4084-b367-bab2992ecacc None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:49.543504 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d5f94-846f-4084-b367-bab2992ecacc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:49.618543 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:49.626359 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d5f94-846f-4084-b367-bab2992ecacc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:49.627934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d5f94-846f-4084-b367-bab2992ecacc None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:49.753622 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 434/862] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:06:49 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:06:49.759369 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c2c51-3566-40ee-b9bd-567d6ac8ef6b None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:49.792517 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:49.881783 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c2c51-3566-40ee-b9bd-567d6ac8ef6b None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:49.924815 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9260d-705b-475a-a191-b770a7d31066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:49.925701 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9260d-705b-475a-a191-b770a7d31066 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:49.926062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9260d-705b-475a-a191-b770a7d31066 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:49.926395 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9260d-705b-475a-a191-b770a7d31066 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:49.941612 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9260d-705b-475a-a191-b770a7d31066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:49.944232 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b9260d-705b-475a-a191-b770a7d31066 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:49.961412 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-67b9260d-705b-475a-a191-b770a7d31066 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:49.961412 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:49.961412 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:49.961412 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:49.961412 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:49.961412 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:49.961412 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:49.961412 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:49.961412 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:49.961412 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:49.961412 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:49.961412 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:49.961412 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:06:49.961412 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:06:49.961412 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:06:49.961412 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:06:49.963019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:49.963019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:49.963019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:49.963019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:49.963019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:49.963019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:49.963019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:49.963019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:49.963019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:49.963019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:49.963019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:49.963019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:49.963019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:49.963019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:49.963019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:49.963019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:49.963019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:06:49.965156 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:06:49.965156 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:49.965156 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:06:49.965156 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 429/863] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:49.969530 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d5f94-846f-4084-b367-bab2992ecacc None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:50.093248 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:50.101983 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d5f94-846f-4084-b367-bab2992ecacc None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:50.146468 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f931bb-51cf-4808-8741-42b7b2e40568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:50.147049 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f931bb-51cf-4808-8741-42b7b2e40568 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:50.147328 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f931bb-51cf-4808-8741-42b7b2e40568 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:50.147595 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f931bb-51cf-4808-8741-42b7b2e40568 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:50.148249 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f931bb-51cf-4808-8741-42b7b2e40568 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:50.148581 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f931bb-51cf-4808-8741-42b7b2e40568 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:50.149935 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f931bb-51cf-4808-8741-42b7b2e40568 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:50.162577 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 435/864] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:50.169170 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9260d-705b-475a-a191-b770a7d31066 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:50.257566 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:50.290009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b9260d-705b-475a-a191-b770a7d31066 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:50.331523 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd0dfe-850b-4eac-a448-081fab855bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:50.332238 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd0dfe-850b-4eac-a448-081fab855bf9 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:50.332577 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd0dfe-850b-4eac-a448-081fab855bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:50.332863 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd0dfe-850b-4eac-a448-081fab855bf9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:50.341983 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd0dfe-850b-4eac-a448-081fab855bf9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:50.343736 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd0dfe-850b-4eac-a448-081fab855bf9 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:50.357105 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-07cd0dfe-850b-4eac-a448-081fab855bf9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:06:50.357105 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:50.357105 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:50.357105 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:50.357105 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:50.357105 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:50.357105 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:50.357105 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:50.357105 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:50.357105 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:50.357105 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:50.357105 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:50.357105 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:06:50.357105 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:06:50.357105 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:06:50.358348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:06:50.358348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:50.358348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:50.358348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:50.358348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:50.358348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:50.358348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:50.358348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:50.358348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:50.358348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:50.358348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:50.358348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:50.358348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:50.358348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:50.358348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:50.358348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:50.358348 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:50.359878 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:06:50.359878 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:06:50.359878 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:06:50.359878 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:06:50.359878 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:06:50.359878 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:06:50.359878 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:06:50.359878 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:06:50.359878 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 430/865] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:06:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 12:06:50.364279 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f931bb-51cf-4808-8741-42b7b2e40568 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:50.487579 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f931bb-51cf-4808-8741-42b7b2e40568 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:50.525872 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad045e3-c24b-4be1-b6b9-0ab63d477aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:50.526521 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad045e3-c24b-4be1-b6b9-0ab63d477aa7 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:50.527340 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad045e3-c24b-4be1-b6b9-0ab63d477aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:50.527648 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad045e3-c24b-4be1-b6b9-0ab63d477aa7 None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:50.528350 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad045e3-c24b-4be1-b6b9-0ab63d477aa7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:50.528658 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad045e3-c24b-4be1-b6b9-0ab63d477aa7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:50.530122 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad045e3-c24b-4be1-b6b9-0ab63d477aa7 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:50.549903 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 436/866] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Sep 13 12:06:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:50.551124 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd0dfe-850b-4eac-a448-081fab855bf9 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:50.683286 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd0dfe-850b-4eac-a448-081fab855bf9 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:50.723912 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c248ad-ae6e-4076-a9de-6e4c62fb3d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:50.724521 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c248ad-ae6e-4076-a9de-6e4c62fb3d4c None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:50.724847 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c248ad-ae6e-4076-a9de-6e4c62fb3d4c None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:50.725127 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c248ad-ae6e-4076-a9de-6e4c62fb3d4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:50.725853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c248ad-ae6e-4076-a9de-6e4c62fb3d4c None admin] RBAC: Adding query filter params (role.id=45922c768b6541549cc7b4aa2d49b0ac, scope.project.id=2cd599a81e8043bebfca960673e63bbc, user.id=e72796c5d7864bd8887419c60e3bbc1b) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:50.726175 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c248ad-ae6e-4076-a9de-6e4c62fb3d4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:50.727631 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c248ad-ae6e-4076-a9de-6e4c62fb3d4c None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:50.729582 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:50.736262 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 431/867] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:06:50 2022] GET /identity/v3/role_assignments?user.id=e72796c5d7864bd8887419c60e3bbc1b&scope.project.id=2cd599a81e8043bebfca960673e63bbc&role.id=45922c768b6541549cc7b4aa2d49b0ac => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:53.369558 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abc247-7586-4813-83b0-5f731087672e None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:53.370097 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abc247-7586-4813-83b0-5f731087672e None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:53.370097 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abc247-7586-4813-83b0-5f731087672e None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:53.371515 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 437/868] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:06:53.377486 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37001398-1d14-4d54-8881-f84d660c1a79 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:53.377933 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37001398-1d14-4d54-8881-f84d660c1a79 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:53.378021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37001398-1d14-4d54-8881-f84d660c1a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:53.396461 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-37001398-1d14-4d54-8881-f84d660c1a79 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:06:53.397667 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-37001398-1d14-4d54-8881-f84d660c1a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:06:53.465460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 432/869] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:06:53 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:06:53.789292 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abc247-7586-4813-83b0-5f731087672e None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:53.808413 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:53.894906 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abc247-7586-4813-83b0-5f731087672e None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:53.931928 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2196b-e14e-4d28-8e5d-6dca993deb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:53.932473 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2196b-e14e-4d28-8e5d-6dca993deb6e None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:53.932795 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2196b-e14e-4d28-8e5d-6dca993deb6e None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:53.933068 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2196b-e14e-4d28-8e5d-6dca993deb6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:53.943655 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2196b-e14e-4d28-8e5d-6dca993deb6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:06:53.949052 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-8bd2196b-e14e-4d28-8e5d-6dca993deb6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:06:53.949052 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:53.949052 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:53.949052 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:53.949052 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:53.949052 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:53.949052 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:53.949052 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:53.949052 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:53.949052 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:53.949052 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:53.949052 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:53.949052 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:06:53.949052 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:06:53.949052 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:06:53.949052 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:06:53.950154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:06:53.950154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:06:53.950154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:06:53.950154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:06:53.950154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:53.950154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:53.950154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:53.950154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:53.950154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:53.950154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:53.950154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:53.950154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:53.950154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:53.950154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:53.950154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:53.950154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:53.951231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:53.951231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:53.951231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:53.951231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:53.951231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:06:53.951231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:06:53.951231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:06:53.951231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:06:53.951231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:06:53.951231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:06:53.951231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:06:53.951231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:06:53.951231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 438/870] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Sep 13 12:06:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:53.956223 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37001398-1d14-4d54-8881-f84d660c1a79 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:54.056240 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37001398-1d14-4d54-8881-f84d660c1a79 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:54.083525 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:54.092570 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bc0fb-4c88-41e0-87a5-5173de6dcee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:54.093179 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bc0fb-4c88-41e0-87a5-5173de6dcee4 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:54.093457 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bc0fb-4c88-41e0-87a5-5173de6dcee4 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:54.093730 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bc0fb-4c88-41e0-87a5-5173de6dcee4 None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:54.094394 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4bc0fb-4c88-41e0-87a5-5173de6dcee4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:54.094736 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4bc0fb-4c88-41e0-87a5-5173de6dcee4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:54.096100 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4bc0fb-4c88-41e0-87a5-5173de6dcee4 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:54.104554 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 433/871] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:06:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:54.110859 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2196b-e14e-4d28-8e5d-6dca993deb6e None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:54.191737 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:54.216048 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2196b-e14e-4d28-8e5d-6dca993deb6e None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:54.250269 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae63479-44d3-4541-bc24-0ba0ee6191c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:54.250924 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae63479-44d3-4541-bc24-0ba0ee6191c5 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:54.251200 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae63479-44d3-4541-bc24-0ba0ee6191c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:54.251470 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae63479-44d3-4541-bc24-0ba0ee6191c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:54.262549 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae63479-44d3-4541-bc24-0ba0ee6191c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:54.264004 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae63479-44d3-4541-bc24-0ba0ee6191c5 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:54.280551 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-1ae63479-44d3-4541-bc24-0ba0ee6191c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:54.280551 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:54.280551 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:54.280551 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:54.280551 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:54.280551 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:54.280551 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:54.280551 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:54.280551 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:54.280551 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:54.280551 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:54.280551 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:54.280551 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:06:54.280551 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:06:54.280551 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:06:54.280551 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:06:54.282682 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:54.282682 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:54.282682 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:54.282682 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:54.282682 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:54.282682 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:54.282682 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:54.282682 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:54.282682 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:54.282682 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:54.282682 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:54.282682 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:54.282682 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:54.282682 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:54.282682 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:54.282682 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:54.282682 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:06:54.284423 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:06:54.284423 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:54.284423 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:06:54.284423 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 439/872] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:54.288799 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bc0fb-4c88-41e0-87a5-5173de6dcee4 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:54.400648 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bc0fb-4c88-41e0-87a5-5173de6dcee4 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:54.434694 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14d581-5c7d-44a1-8759-d5fa6395856f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:54.435294 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14d581-5c7d-44a1-8759-d5fa6395856f None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:54.435572 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14d581-5c7d-44a1-8759-d5fa6395856f None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:54.435844 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14d581-5c7d-44a1-8759-d5fa6395856f None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:54.436491 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14d581-5c7d-44a1-8759-d5fa6395856f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:54.436792 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14d581-5c7d-44a1-8759-d5fa6395856f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:54.438176 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14d581-5c7d-44a1-8759-d5fa6395856f None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:54.451041 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 434/873] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:06:54.456747 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae63479-44d3-4541-bc24-0ba0ee6191c5 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:54.560990 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae63479-44d3-4541-bc24-0ba0ee6191c5 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:54.589746 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:54.598658 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea976c3-1df6-44cf-986d-4d9fd6f9a3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:54.599315 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea976c3-1df6-44cf-986d-4d9fd6f9a3e9 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:54.599592 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea976c3-1df6-44cf-986d-4d9fd6f9a3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:54.599863 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea976c3-1df6-44cf-986d-4d9fd6f9a3e9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:54.607834 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea976c3-1df6-44cf-986d-4d9fd6f9a3e9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:54.609273 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea976c3-1df6-44cf-986d-4d9fd6f9a3e9 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:54.623078 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-dea976c3-1df6-44cf-986d-4d9fd6f9a3e9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:06:54.623078 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:54.623078 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:54.623078 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:54.623078 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:54.623078 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:54.623078 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:54.623078 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:54.623078 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:54.623078 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:54.623078 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:54.623078 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:54.623078 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:06:54.623078 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:06:54.623078 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:06:54.623078 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:06:54.624917 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:54.624917 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:54.624917 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:06:54.624917 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:06:54.624917 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:06:54.624917 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:06:54.624917 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:54.624917 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:54.624917 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:54.624917 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:54.624917 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:54.624917 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:54.624917 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:54.624917 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:54.624917 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:54.624917 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:54.624917 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:54.624917 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:54.626139 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:54.626139 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:54.626139 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:06:54.626139 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:06:54.626139 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:06:54.626139 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:06:54.626139 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:06:54.626139 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:06:54.626139 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:06:54.626139 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:06:54.626139 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 440/874] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:54.631288 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14d581-5c7d-44a1-8759-d5fa6395856f None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:54.685007 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:54.736006 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14d581-5c7d-44a1-8759-d5fa6395856f None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:54.770789 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1a877-1e50-4cbb-afe6-74ed477d6574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:54.771388 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1a877-1e50-4cbb-afe6-74ed477d6574 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:54.771668 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1a877-1e50-4cbb-afe6-74ed477d6574 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:54.771939 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1a877-1e50-4cbb-afe6-74ed477d6574 None admin] PATH_INFO: `/v3/users` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:54.772663 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1a877-1e50-4cbb-afe6-74ed477d6574 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:54.772969 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1a877-1e50-4cbb-afe6-74ed477d6574 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:54.774391 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1a877-1e50-4cbb-afe6-74ed477d6574 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:54.792897 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 435/875] 10.222.0.15 () {56 vars in 1143 bytes} [Tue Sep 13 12:06:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:54.798811 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea976c3-1df6-44cf-986d-4d9fd6f9a3e9 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:54.902283 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea976c3-1df6-44cf-986d-4d9fd6f9a3e9 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:54.936888 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d1b5e-ae59-4e8b-adfb-6e1a96bab848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:54.937490 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d1b5e-ae59-4e8b-adfb-6e1a96bab848 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:54.937767 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d1b5e-ae59-4e8b-adfb-6e1a96bab848 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:54.938037 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d1b5e-ae59-4e8b-adfb-6e1a96bab848 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:54.997404 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:55.012199 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d1b5e-ae59-4e8b-adfb-6e1a96bab848 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:55.013807 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d1b5e-ae59-4e8b-adfb-6e1a96bab848 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:55.113110 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 441/876] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:06:54 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:06:55.119129 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1a877-1e50-4cbb-afe6-74ed477d6574 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:55.220230 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1a877-1e50-4cbb-afe6-74ed477d6574 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:55.229490 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:55.254729 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09ce04-3ac2-4913-8896-632afe6bc7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:55.255282 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09ce04-3ac2-4913-8896-632afe6bc7f1 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:55.255564 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09ce04-3ac2-4913-8896-632afe6bc7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:55.255832 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09ce04-3ac2-4913-8896-632afe6bc7f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:55.267415 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09ce04-3ac2-4913-8896-632afe6bc7f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:55.268858 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d09ce04-3ac2-4913-8896-632afe6bc7f1 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:55.283969 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-5d09ce04-3ac2-4913-8896-632afe6bc7f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:55.283969 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:55.283969 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:55.283969 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:55.283969 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:55.283969 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:55.283969 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:55.283969 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:55.283969 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:55.283969 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:55.283969 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:55.283969 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:55.283969 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:06:55.283969 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:06:55.283969 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:06:55.283969 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:06:55.285089 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:55.285089 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:55.285089 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:55.285089 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:55.285089 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:55.285089 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:55.285089 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:55.285089 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:55.285089 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:55.285089 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:55.285089 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:55.285089 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:55.285089 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:55.285089 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:55.285089 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:55.285089 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:55.285089 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:06:55.285993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:06:55.285993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:55.285993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:06:55.285993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 436/877] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:55.293629 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d1b5e-ae59-4e8b-adfb-6e1a96bab848 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:55.382925 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:55.395923 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d1b5e-ae59-4e8b-adfb-6e1a96bab848 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:55.430013 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc195a1-e9ba-4cff-abdb-a787dc7facec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:55.430636 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc195a1-e9ba-4cff-abdb-a787dc7facec None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:55.430916 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc195a1-e9ba-4cff-abdb-a787dc7facec None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:55.431185 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc195a1-e9ba-4cff-abdb-a787dc7facec None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:55.431828 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc195a1-e9ba-4cff-abdb-a787dc7facec None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:55.432127 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc195a1-e9ba-4cff-abdb-a787dc7facec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:55.434257 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc195a1-e9ba-4cff-abdb-a787dc7facec None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:55.445841 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 442/878] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:55.451777 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09ce04-3ac2-4913-8896-632afe6bc7f1 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:55.563106 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d09ce04-3ac2-4913-8896-632afe6bc7f1 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:55.596814 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a6780-4bbd-4269-831c-b389619e134e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:55.597454 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a6780-4bbd-4269-831c-b389619e134e None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:55.597737 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a6780-4bbd-4269-831c-b389619e134e None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:55.598010 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a6780-4bbd-4269-831c-b389619e134e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:55.605735 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a6780-4bbd-4269-831c-b389619e134e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:55.607347 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a6780-4bbd-4269-831c-b389619e134e None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:55.619201 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-389a6780-4bbd-4269-831c-b389619e134e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:06:55.619201 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:55.619201 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:55.619201 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:55.619201 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:55.619201 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:55.619201 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:55.619201 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:55.619201 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:55.619201 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:55.619201 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:55.619201 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:55.619201 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:06:55.619201 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:06:55.619201 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:06:55.620332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:06:55.620332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:55.620332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:55.620332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:55.620332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:55.620332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:55.620332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:55.620332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:55.620332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:55.620332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:55.620332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:55.620332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:55.620332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:55.620332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:55.620332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:55.620332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:55.620332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:55.621575 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:06:55.621575 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:06:55.621575 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:06:55.621575 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:06:55.621575 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:06:55.621575 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:06:55.621575 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:06:55.621575 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:06:55.621575 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 437/879] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:06:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:55.627015 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc195a1-e9ba-4cff-abdb-a787dc7facec None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:55.729772 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc195a1-e9ba-4cff-abdb-a787dc7facec None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:55.765043 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28b23c-aec9-4db1-b858-a00dd741eef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:55.765642 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28b23c-aec9-4db1-b858-a00dd741eef0 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:55.765916 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28b23c-aec9-4db1-b858-a00dd741eef0 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:55.766181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28b23c-aec9-4db1-b858-a00dd741eef0 None admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:55.766904 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28b23c-aec9-4db1-b858-a00dd741eef0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:55.767209 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28b23c-aec9-4db1-b858-a00dd741eef0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:55.768617 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28b23c-aec9-4db1-b858-a00dd741eef0 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:55.781065 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 443/880] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Sep 13 12:06:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:55.787228 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a6780-4bbd-4269-831c-b389619e134e None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:55.811880 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:55.900851 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a6780-4bbd-4269-831c-b389619e134e None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:55.939383 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af413b-574a-4a2b-b2fb-2848ebd83155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:55.939982 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af413b-574a-4a2b-b2fb-2848ebd83155 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:55.940261 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af413b-574a-4a2b-b2fb-2848ebd83155 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:55.940537 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af413b-574a-4a2b-b2fb-2848ebd83155 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:55.941290 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af413b-574a-4a2b-b2fb-2848ebd83155 None admin] RBAC: Adding query filter params (role.id=5609ac7373ba400593bba6d811e3aa72, scope.project.id=2cd599a81e8043bebfca960673e63bbc, user.id=e72796c5d7864bd8887419c60e3bbc1b) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:55.941602 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af413b-574a-4a2b-b2fb-2848ebd83155 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:55.943065 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af413b-574a-4a2b-b2fb-2848ebd83155 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:55.949222 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 438/881] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:06:55 2022] GET /identity/v3/role_assignments?user.id=e72796c5d7864bd8887419c60e3bbc1b&scope.project.id=2cd599a81e8043bebfca960673e63bbc&role.id=5609ac7373ba400593bba6d811e3aa72 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:58.435320 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f1381-c560-40a9-b59f-e4b1ce760e11 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:58.435864 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f1381-c560-40a9-b59f-e4b1ce760e11 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:58.435864 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f1381-c560-40a9-b59f-e4b1ce760e11 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:58.437212 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 444/882] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:06:58.443193 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f08e0-082a-4682-9be4-4ebc02c744a1 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:58.443644 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f08e0-082a-4682-9be4-4ebc02c744a1 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:58.443777 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f08e0-082a-4682-9be4-4ebc02c744a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:58.461979 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-e62f08e0-082a-4682-9be4-4ebc02c744a1 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:06:58.463230 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-e62f08e0-082a-4682-9be4-4ebc02c744a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:06:58.531185 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 439/883] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:06:58 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:06:58.855055 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f1381-c560-40a9-b59f-e4b1ce760e11 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:58.866043 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:58.960498 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f1381-c560-40a9-b59f-e4b1ce760e11 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:58.995488 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532cbca-c930-43ca-bac6-32406d04003a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:58.996114 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532cbca-c930-43ca-bac6-32406d04003a None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:58.996392 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532cbca-c930-43ca-bac6-32406d04003a None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:58.996662 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532cbca-c930-43ca-bac6-32406d04003a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:59.006856 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532cbca-c930-43ca-bac6-32406d04003a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:06:59.011642 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-0532cbca-c930-43ca-bac6-32406d04003a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:06:59.011642 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:59.011642 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:59.011642 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:59.011642 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:59.011642 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:59.011642 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:59.011642 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:59.011642 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:59.011642 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:59.011642 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:59.011642 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:59.011642 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:06:59.011642 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:06:59.011642 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:06:59.011642 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:06:59.012696 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:06:59.012696 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:06:59.012696 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:06:59.012696 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:06:59.012696 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:59.012696 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:59.012696 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:59.012696 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:59.012696 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:59.012696 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:59.012696 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:59.012696 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:59.012696 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:59.012696 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:59.012696 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:59.012696 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:59.013929 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:59.013929 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:59.013929 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:59.013929 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:59.013929 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:06:59.013929 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:06:59.013929 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:06:59.013929 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:06:59.013929 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:06:59.013929 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:06:59.013929 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:06:59.013929 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:06:59.013929 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 445/884] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Sep 13 12:06:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:59.018750 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f08e0-082a-4682-9be4-4ebc02c744a1 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:59.034150 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:59.124622 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f08e0-082a-4682-9be4-4ebc02c744a1 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:59.163123 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1170f-e9e4-45bc-9dcd-825caabef8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:59.163746 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1170f-e9e4-45bc-9dcd-825caabef8cf None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:59.164012 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1170f-e9e4-45bc-9dcd-825caabef8cf None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:59.164544 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1170f-e9e4-45bc-9dcd-825caabef8cf None admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:59.165204 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1170f-e9e4-45bc-9dcd-825caabef8cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:59.165502 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1170f-e9e4-45bc-9dcd-825caabef8cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:59.167062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1170f-e9e4-45bc-9dcd-825caabef8cf None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:59.175683 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 440/885] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:06:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:59.181419 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532cbca-c930-43ca-bac6-32406d04003a None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:59.253520 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:59.302977 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532cbca-c930-43ca-bac6-32406d04003a None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:59.357806 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17141a52-3b10-437b-94d9-20d8ace9c94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:59.358436 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17141a52-3b10-437b-94d9-20d8ace9c94d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:59.358752 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17141a52-3b10-437b-94d9-20d8ace9c94d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:59.359028 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17141a52-3b10-437b-94d9-20d8ace9c94d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:59.369393 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17141a52-3b10-437b-94d9-20d8ace9c94d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:59.371005 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17141a52-3b10-437b-94d9-20d8ace9c94d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:59.386664 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-17141a52-3b10-437b-94d9-20d8ace9c94d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:59.386664 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:59.386664 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:59.386664 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:59.386664 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:59.386664 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:59.386664 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:59.386664 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:59.386664 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:59.386664 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:59.386664 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:59.386664 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:59.386664 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:06:59.386664 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:06:59.386664 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:06:59.386664 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:06:59.388455 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:59.388455 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:59.388455 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:59.388455 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:59.388455 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:59.388455 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:59.388455 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:59.388455 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:59.388455 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:59.388455 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:59.388455 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:59.388455 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:59.388455 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:59.388455 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:59.388455 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:59.388455 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:59.388455 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:06:59.389630 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:06:59.389630 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:06:59.389630 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:06:59.389630 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 446/886] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:59.393691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1170f-e9e4-45bc-9dcd-825caabef8cf None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:59.474865 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:59.499846 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1170f-e9e4-45bc-9dcd-825caabef8cf None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:59.534331 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2513278-5b87-4b5f-8668-a37400ccfccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:59.534966 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2513278-5b87-4b5f-8668-a37400ccfccb None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:59.535243 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2513278-5b87-4b5f-8668-a37400ccfccb None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:59.535514 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2513278-5b87-4b5f-8668-a37400ccfccb None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:59.536156 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2513278-5b87-4b5f-8668-a37400ccfccb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:59.536458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2513278-5b87-4b5f-8668-a37400ccfccb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:59.537815 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2513278-5b87-4b5f-8668-a37400ccfccb None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:59.550902 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 441/887] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:59.556712 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17141a52-3b10-437b-94d9-20d8ace9c94d None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:59.681743 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17141a52-3b10-437b-94d9-20d8ace9c94d None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:59.702173 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:59.720586 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009913c2-e8c9-4077-925c-89d6ed71711d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:59.721213 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009913c2-e8c9-4077-925c-89d6ed71711d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:59.721489 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009913c2-e8c9-4077-925c-89d6ed71711d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:59.721759 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009913c2-e8c9-4077-925c-89d6ed71711d None admin] PATH_INFO: `/v3/users/placement` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:59.729532 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009913c2-e8c9-4077-925c-89d6ed71711d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:59.731525 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009913c2-e8c9-4077-925c-89d6ed71711d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:59.743297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-009913c2-e8c9-4077-925c-89d6ed71711d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:06:59.743297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:06:59.743297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:06:59.743297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:06:59.743297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:06:59.743297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:06:59.743297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:06:59.743297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:06:59.743297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:06:59.743297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:06:59.743297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:06:59.743297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:06:59.743297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:06:59.743297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:06:59.743297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:06:59.743297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:06:59.744588 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:06:59.744588 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:06:59.744588 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:06:59.744588 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:06:59.744588 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:06:59.744588 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:06:59.744588 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:06:59.744588 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:06:59.744588 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:06:59.744588 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:06:59.744588 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:06:59.744588 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:06:59.744588 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:06:59.744588 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:06:59.744588 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:06:59.744588 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:06:59.744588 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:06:59.744588 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:06:59.745846 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:06:59.745846 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:06:59.745846 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:06:59.745846 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:06:59.745846 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:06:59.745846 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:06:59.745846 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:06:59.745846 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:06:59.745846 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:06:59.745846 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:06:59.745846 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 447/888] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:06:59.750396 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2513278-5b87-4b5f-8668-a37400ccfccb None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:06:59.852830 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2513278-5b87-4b5f-8668-a37400ccfccb None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:06:59.888977 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a9fac-a95a-492c-89a6-b61aa75a4042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:06:59.889577 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a9fac-a95a-492c-89a6-b61aa75a4042 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:06:59.889862 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a9fac-a95a-492c-89a6-b61aa75a4042 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:06:59.890137 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a9fac-a95a-492c-89a6-b61aa75a4042 None admin] PATH_INFO: `/v3/users` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:06:59.890900 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a9fac-a95a-492c-89a6-b61aa75a4042 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:06:59.891206 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a9fac-a95a-492c-89a6-b61aa75a4042 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:06:59.892637 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a9fac-a95a-492c-89a6-b61aa75a4042 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:06:59.895607 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:06:59.912155 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 442/889] 10.222.0.15 () {56 vars in 1143 bytes} [Tue Sep 13 12:06:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:06:59.918373 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009913c2-e8c9-4077-925c-89d6ed71711d None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:00.031430 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009913c2-e8c9-4077-925c-89d6ed71711d None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:00.064974 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33bbeb-e797-4a0f-bcf7-17b8e12ab01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:00.065595 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33bbeb-e797-4a0f-bcf7-17b8e12ab01f None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:00.065873 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33bbeb-e797-4a0f-bcf7-17b8e12ab01f None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:00.066148 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33bbeb-e797-4a0f-bcf7-17b8e12ab01f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:00.077409 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33bbeb-e797-4a0f-bcf7-17b8e12ab01f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:00.078859 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33bbeb-e797-4a0f-bcf7-17b8e12ab01f None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:00.093888 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-cb33bbeb-e797-4a0f-bcf7-17b8e12ab01f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:07:00.093888 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:07:00.093888 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:07:00.093888 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:07:00.093888 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:07:00.093888 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:07:00.093888 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:07:00.093888 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:07:00.093888 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:07:00.093888 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:07:00.093888 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:07:00.093888 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:07:00.093888 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:07:00.093888 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:07:00.093888 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:07:00.093888 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:07:00.095310 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:07:00.095310 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:07:00.095310 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:07:00.095310 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:07:00.095310 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:07:00.095310 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:07:00.095310 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:07:00.095310 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:07:00.095310 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:07:00.095310 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:07:00.095310 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:07:00.095310 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:07:00.095310 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:07:00.095310 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:07:00.095310 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:07:00.095310 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:07:00.095310 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:07:00.096379 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:07:00.096379 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:07:00.096379 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:07:00.096379 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 448/890] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:07:00.100800 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a9fac-a95a-492c-89a6-b61aa75a4042 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:00.201743 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a9fac-a95a-492c-89a6-b61aa75a4042 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:00.237086 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6b502-9787-4be0-842a-1fda2ad833fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:00.237679 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6b502-9787-4be0-842a-1fda2ad833fe None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:00.237957 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6b502-9787-4be0-842a-1fda2ad833fe None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:00.238251 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6b502-9787-4be0-842a-1fda2ad833fe None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:00.238890 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6b502-9787-4be0-842a-1fda2ad833fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:07:00.239189 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6b502-9787-4be0-842a-1fda2ad833fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:00.240549 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6b502-9787-4be0-842a-1fda2ad833fe None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:00.253029 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 443/891] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:07:00.259195 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33bbeb-e797-4a0f-bcf7-17b8e12ab01f None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:00.298670 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:07:00.372916 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33bbeb-e797-4a0f-bcf7-17b8e12ab01f None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:00.408256 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1e9f7-42ff-437f-80e6-13af2793b9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:00.408890 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1e9f7-42ff-437f-80e6-13af2793b9e7 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:00.409171 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1e9f7-42ff-437f-80e6-13af2793b9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:00.409544 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1e9f7-42ff-437f-80e6-13af2793b9e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:00.417157 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1e9f7-42ff-437f-80e6-13af2793b9e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:00.418603 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1e9f7-42ff-437f-80e6-13af2793b9e7 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:00.429982 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-7fb1e9f7-42ff-437f-80e6-13af2793b9e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:07:00.429982 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:07:00.429982 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:07:00.429982 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:07:00.429982 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:07:00.429982 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:07:00.429982 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:07:00.429982 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:07:00.429982 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:07:00.429982 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:07:00.429982 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:07:00.429982 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:07:00.429982 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:07:00.429982 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:07:00.429982 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:07:00.434803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:07:00.434803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:07:00.434803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:07:00.434803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:07:00.434803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:07:00.434803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:07:00.434803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:07:00.434803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:07:00.434803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:07:00.434803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:07:00.434803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:07:00.434803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:07:00.434803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:07:00.434803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:07:00.434803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:07:00.434803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:07:00.434803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:07:00.435920 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:07:00.435920 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:07:00.435920 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:07:00.435920 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:07:00.435920 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:07:00.435920 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:07:00.435920 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:07:00.435920 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:07:00.435920 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 449/892] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:07:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:07:00.439479 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6b502-9787-4be0-842a-1fda2ad833fe None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:00.495652 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:07:00.540829 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6b502-9787-4be0-842a-1fda2ad833fe None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:00.575782 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010806d6-62d9-467a-9a82-9c7f644b09df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:00.576296 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010806d6-62d9-467a-9a82-9c7f644b09df None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:00.576575 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010806d6-62d9-467a-9a82-9c7f644b09df None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:00.576849 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010806d6-62d9-467a-9a82-9c7f644b09df None admin] PATH_INFO: `/v3/projects` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:00.577539 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010806d6-62d9-467a-9a82-9c7f644b09df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:07:00.577843 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010806d6-62d9-467a-9a82-9c7f644b09df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:00.579301 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010806d6-62d9-467a-9a82-9c7f644b09df None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:00.592291 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 444/893] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Sep 13 12:07:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:07:00.598383 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1e9f7-42ff-437f-80e6-13af2793b9e7 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:00.693852 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:07:00.703713 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1e9f7-42ff-437f-80e6-13af2793b9e7 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:00.737138 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8e975-7e06-46f7-935f-2530822cc8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:00.740659 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8e975-7e06-46f7-935f-2530822cc8c9 None admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:00.740659 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8e975-7e06-46f7-935f-2530822cc8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:00.740659 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8e975-7e06-46f7-935f-2530822cc8c9 None admin] PATH_INFO: `/v3/projects/2cd599a81e8043bebfca960673e63bbc/users/e72796c5d7864bd8887419c60e3bbc1b/roles/5609ac7373ba400593bba6d811e3aa72` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:00.740659 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8e975-7e06-46f7-935f-2530822cc8c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2cd599a81e8043bebfca960673e63bbc, user_id=e72796c5d7864bd8887419c60e3bbc1b, role_id=5609ac7373ba400593bba6d811e3aa72)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:00.741688 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8e975-7e06-46f7-935f-2530822cc8c9 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:00.755400 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 450/894] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Sep 13 12:07:00 2022] PUT /identity/v3/projects/2cd599a81e8043bebfca960673e63bbc/users/e72796c5d7864bd8887419c60e3bbc1b/roles/5609ac7373ba400593bba6d811e3aa72 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:07:03.208424 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a01459-2d35-4d42-8324-0f6d1d6560d9 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:03.209020 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a01459-2d35-4d42-8324-0f6d1d6560d9 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:03.209020 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a01459-2d35-4d42-8324-0f6d1d6560d9 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:03.210279 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 445/895] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:07:03.216388 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a125e-803b-4162-afb3-4fc5ac7e13ff None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:03.216842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a125e-803b-4162-afb3-4fc5ac7e13ff None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:03.217022 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a125e-803b-4162-afb3-4fc5ac7e13ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:03.235518 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-f91a125e-803b-4162-afb3-4fc5ac7e13ff None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:07:03.236759 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-f91a125e-803b-4162-afb3-4fc5ac7e13ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:07:03.319467 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 451/896] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:07:03 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:07:03.647840 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a01459-2d35-4d42-8324-0f6d1d6560d9 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:03.754876 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a01459-2d35-4d42-8324-0f6d1d6560d9 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:03.769486 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:07:03.790084 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55203a-a133-4c25-8ff5-ccacecaf031d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:03.790728 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55203a-a133-4c25-8ff5-ccacecaf031d None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:03.791565 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55203a-a133-4c25-8ff5-ccacecaf031d None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:03.791983 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55203a-a133-4c25-8ff5-ccacecaf031d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:03.802726 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55203a-a133-4c25-8ff5-ccacecaf031d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 12:07:03.808453 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-4e55203a-a133-4c25-8ff5-ccacecaf031d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:07:03.808453 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:07:03.808453 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:07:03.808453 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:07:03.808453 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:07:03.808453 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:07:03.808453 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:07:03.808453 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:07:03.808453 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:07:03.808453 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:07:03.808453 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:07:03.808453 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:07:03.808453 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 12:07:03.808453 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 12:07:03.808453 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 12:07:03.808453 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 12:07:03.809661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 12:07:03.809661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 12:07:03.809661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 12:07:03.809661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 12:07:03.809661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:07:03.809661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:07:03.809661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:07:03.809661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:07:03.809661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:07:03.809661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:07:03.809661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:07:03.809661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:07:03.809661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:07:03.809661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:07:03.809661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:07:03.809661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:07:03.810587 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:07:03.810587 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:07:03.810587 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:07:03.810587 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:07:03.810587 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 12:07:03.810587 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 12:07:03.810587 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 12:07:03.810587 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 12:07:03.810587 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 12:07:03.810587 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 12:07:03.810587 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 12:07:03.810587 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:07:03.810587 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 446/897] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Sep 13 12:07:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:07:03.815875 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a125e-803b-4162-afb3-4fc5ac7e13ff None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:03.899535 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:07:03.919897 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a125e-803b-4162-afb3-4fc5ac7e13ff None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:03.954241 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2674ddb-0974-4556-a26d-e4115ca61359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:03.954889 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2674ddb-0974-4556-a26d-e4115ca61359 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:03.955173 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2674ddb-0974-4556-a26d-e4115ca61359 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:03.955448 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2674ddb-0974-4556-a26d-e4115ca61359 None admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:03.957307 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2674ddb-0974-4556-a26d-e4115ca61359 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:07:03.957307 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2674ddb-0974-4556-a26d-e4115ca61359 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:03.957780 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2674ddb-0974-4556-a26d-e4115ca61359 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:03.967238 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 452/898] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Sep 13 12:07:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:07:03.973046 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55203a-a133-4c25-8ff5-ccacecaf031d None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:04.075639 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55203a-a133-4c25-8ff5-ccacecaf031d None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:04.111996 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee36d1d-a69e-4fc3-b5e0-9ecc0b6b4092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:04.112609 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee36d1d-a69e-4fc3-b5e0-9ecc0b6b4092 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:04.112885 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee36d1d-a69e-4fc3-b5e0-9ecc0b6b4092 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:04.113157 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee36d1d-a69e-4fc3-b5e0-9ecc0b6b4092 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:04.124077 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee36d1d-a69e-4fc3-b5e0-9ecc0b6b4092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:04.125657 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee36d1d-a69e-4fc3-b5e0-9ecc0b6b4092 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:04.142931 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-eee36d1d-a69e-4fc3-b5e0-9ecc0b6b4092 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:07:04.142931 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:07:04.142931 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:07:04.142931 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:07:04.142931 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:07:04.142931 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:07:04.142931 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:07:04.142931 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:07:04.142931 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:07:04.142931 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:07:04.142931 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:07:04.142931 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:07:04.142931 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:07:04.142931 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:07:04.142931 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:07:04.142931 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:07:04.144047 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:07:04.144047 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:07:04.144047 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:07:04.144047 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:07:04.144047 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:07:04.144047 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:07:04.144047 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:07:04.144047 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:07:04.144047 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:07:04.144047 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:07:04.144047 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:07:04.144047 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:07:04.144047 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:07:04.144047 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:07:04.144047 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:07:04.144047 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:07:04.144047 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:07:04.145276 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:07:04.145276 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:07:04.145276 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:07:04.145276 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 447/899] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:07:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:07:04.149920 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2674ddb-0974-4556-a26d-e4115ca61359 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:04.251917 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2674ddb-0974-4556-a26d-e4115ca61359 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:04.289304 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f443da-5abc-4958-ad0d-6dfad7ccbac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:04.289905 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f443da-5abc-4958-ad0d-6dfad7ccbac6 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:04.290181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f443da-5abc-4958-ad0d-6dfad7ccbac6 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:04.290449 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f443da-5abc-4958-ad0d-6dfad7ccbac6 None admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:04.291870 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f443da-5abc-4958-ad0d-6dfad7ccbac6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:07:04.292495 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f443da-5abc-4958-ad0d-6dfad7ccbac6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:04.293863 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f443da-5abc-4958-ad0d-6dfad7ccbac6 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:04.306017 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 453/900] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:07:04.311734 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee36d1d-a69e-4fc3-b5e0-9ecc0b6b4092 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:04.339922 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:07:04.416052 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee36d1d-a69e-4fc3-b5e0-9ecc0b6b4092 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:04.450763 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc178a59-4fe7-4b03-ad67-f1abde4b62cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:04.451380 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc178a59-4fe7-4b03-ad67-f1abde4b62cf None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:04.451660 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc178a59-4fe7-4b03-ad67-f1abde4b62cf None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:04.451928 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc178a59-4fe7-4b03-ad67-f1abde4b62cf None admin] PATH_INFO: `/v3/users/placement` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:04.459579 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc178a59-4fe7-4b03-ad67-f1abde4b62cf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:04.461068 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc178a59-4fe7-4b03-ad67-f1abde4b62cf None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:04.473257 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-cc178a59-4fe7-4b03-ad67-f1abde4b62cf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:07:04.473257 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:07:04.473257 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:07:04.473257 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:07:04.473257 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:07:04.473257 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:07:04.473257 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:07:04.473257 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:07:04.473257 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:07:04.473257 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:07:04.473257 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:07:04.473257 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:07:04.473257 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 12:07:04.473257 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 12:07:04.473257 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 12:07:04.473257 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 12:07:04.474704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:07:04.474704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:07:04.474704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 12:07:04.474704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:07:04.474704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 12:07:04.474704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 12:07:04.474704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:07:04.474704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:07:04.474704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:07:04.474704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:07:04.474704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:07:04.474704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:07:04.474704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:07:04.474704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:07:04.474704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:07:04.474704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:07:04.474704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:07:04.474704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:07:04.475642 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:07:04.475642 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:07:04.475642 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 12:07:04.475642 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 12:07:04.475642 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 12:07:04.475642 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 12:07:04.475642 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 12:07:04.475642 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 12:07:04.475642 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 12:07:04.475642 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:07:04.475642 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 448/901] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:07:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:07:04.480535 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f443da-5abc-4958-ad0d-6dfad7ccbac6 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:04.484593 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:07:04.582090 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f443da-5abc-4958-ad0d-6dfad7ccbac6 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:04.625370 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae3455-295b-4472-8cce-8b405e34c69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:04.626190 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae3455-295b-4472-8cce-8b405e34c69c None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:04.626527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae3455-295b-4472-8cce-8b405e34c69c None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:04.626848 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae3455-295b-4472-8cce-8b405e34c69c None admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:04.627736 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae3455-295b-4472-8cce-8b405e34c69c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:07:04.628164 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae3455-295b-4472-8cce-8b405e34c69c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:04.629597 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae3455-295b-4472-8cce-8b405e34c69c None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:04.647631 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 454/902] 10.222.0.15 () {56 vars in 1143 bytes} [Tue Sep 13 12:07:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:07:04.653739 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc178a59-4fe7-4b03-ad67-f1abde4b62cf None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:04.744047 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:07:04.759497 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc178a59-4fe7-4b03-ad67-f1abde4b62cf None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:04.794185 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0087843-9109-42fc-93a9-c4bd36b2748e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:04.795122 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0087843-9109-42fc-93a9-c4bd36b2748e None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:04.795466 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0087843-9109-42fc-93a9-c4bd36b2748e None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:04.795745 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0087843-9109-42fc-93a9-c4bd36b2748e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:04.863645 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0087843-9109-42fc-93a9-c4bd36b2748e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:04.865081 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0087843-9109-42fc-93a9-c4bd36b2748e None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:04.950377 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:07:04.966287 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 449/903] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Sep 13 12:07:04 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 12:07:04.972063 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae3455-295b-4472-8cce-8b405e34c69c None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:05.032215 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:07:05.071367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae3455-295b-4472-8cce-8b405e34c69c None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:05.104980 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef7cc2-ecac-4c77-a254-ed98acfd4c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:05.105592 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef7cc2-ecac-4c77-a254-ed98acfd4c00 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:05.105872 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef7cc2-ecac-4c77-a254-ed98acfd4c00 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:05.106143 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef7cc2-ecac-4c77-a254-ed98acfd4c00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:05.115886 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef7cc2-ecac-4c77-a254-ed98acfd4c00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:05.117304 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef7cc2-ecac-4c77-a254-ed98acfd4c00 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:05.131527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-b4ef7cc2-ecac-4c77-a254-ed98acfd4c00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:07:05.131527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:07:05.131527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:07:05.131527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:07:05.131527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:07:05.131527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:07:05.131527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:07:05.131527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:07:05.131527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:07:05.131527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:07:05.131527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:07:05.131527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:07:05.131527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 12:07:05.131527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 12:07:05.131527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 12:07:05.131527 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 12:07:05.132710 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:07:05.132710 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:07:05.132710 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:07:05.132710 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:07:05.132710 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:07:05.132710 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:07:05.132710 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:07:05.132710 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:07:05.132710 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:07:05.132710 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:07:05.132710 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:07:05.132710 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:07:05.132710 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:07:05.132710 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:07:05.132710 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:07:05.132710 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:07:05.132710 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 12:07:05.133626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 12:07:05.133626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 12:07:05.133626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:07:05.133626 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 455/904] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:07:05.139242 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0087843-9109-42fc-93a9-c4bd36b2748e None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:05.241292 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0087843-9109-42fc-93a9-c4bd36b2748e None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:05.277942 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881a4d2-160a-4fb1-b6c8-94d90d90f0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:05.278542 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881a4d2-160a-4fb1-b6c8-94d90d90f0ff None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:05.278851 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881a4d2-160a-4fb1-b6c8-94d90d90f0ff None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:05.279133 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881a4d2-160a-4fb1-b6c8-94d90d90f0ff None admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:05.279771 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881a4d2-160a-4fb1-b6c8-94d90d90f0ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:07:05.280075 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881a4d2-160a-4fb1-b6c8-94d90d90f0ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:05.281436 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881a4d2-160a-4fb1-b6c8-94d90d90f0ff None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:05.292877 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 450/905] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Sep 13 12:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:07:05.298634 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef7cc2-ecac-4c77-a254-ed98acfd4c00 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:05.397059 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef7cc2-ecac-4c77-a254-ed98acfd4c00 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:05.411041 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:07:05.431137 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314444c1-9cac-4870-8696-ac16dfd1f580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:05.431762 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314444c1-9cac-4870-8696-ac16dfd1f580 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:05.432042 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314444c1-9cac-4870-8696-ac16dfd1f580 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:05.432417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314444c1-9cac-4870-8696-ac16dfd1f580 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:05.440280 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314444c1-9cac-4870-8696-ac16dfd1f580 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:05.441526 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314444c1-9cac-4870-8696-ac16dfd1f580 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:05.453510 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application [None req-314444c1-9cac-4870-8696-ac16dfd1f580 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:07:05.453510 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:07:05.453510 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:07:05.453510 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:07:05.453510 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:07:05.453510 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:07:05.453510 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:07:05.453510 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:07:05.453510 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:07:05.453510 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:07:05.453510 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:07:05.453510 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:07:05.453510 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 12:07:05.453510 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 12:07:05.453510 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 12:07:05.454656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 12:07:05.454656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:07:05.454656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:07:05.454656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:07:05.454656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:07:05.454656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:07:05.454656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:07:05.454656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:07:05.454656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application with Lock( Sep 13 12:07:05.454656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:07:05.454656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:07:05.454656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:07:05.454656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:07:05.454656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:07:05.454656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:07:05.454656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:07:05.454656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:07:05.455566 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 12:07:05.455566 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 12:07:05.455566 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 12:07:05.455566 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 12:07:05.455566 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 12:07:05.455566 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 12:07:05.455566 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 12:07:05.455566 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: ERROR keystone.server.flask.application Sep 13 12:07:05.455566 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 456/906] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Sep 13 12:07:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:07:05.460697 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881a4d2-160a-4fb1-b6c8-94d90d90f0ff None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:05.519545 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:07:05.579105 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881a4d2-160a-4fb1-b6c8-94d90d90f0ff None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:05.614145 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74937d-8b22-4ef7-be68-12e3e24775f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:05.614821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74937d-8b22-4ef7-be68-12e3e24775f6 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:05.615097 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74937d-8b22-4ef7-be68-12e3e24775f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:05.615364 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74937d-8b22-4ef7-be68-12e3e24775f6 None admin] PATH_INFO: `/v3/projects` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:05.616060 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74937d-8b22-4ef7-be68-12e3e24775f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:07:05.616361 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74937d-8b22-4ef7-be68-12e3e24775f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:05.617790 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74937d-8b22-4ef7-be68-12e3e24775f6 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:05.630661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 451/907] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Sep 13 12:07:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:07:05.637409 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314444c1-9cac-4870-8696-ac16dfd1f580 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:05.740947 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314444c1-9cac-4870-8696-ac16dfd1f580 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:05.774932 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ad58a-ac01-4643-ac0c-a1329bb8c2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:05.775773 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ad58a-ac01-4643-ac0c-a1329bb8c2f3 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:05.776044 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ad58a-ac01-4643-ac0c-a1329bb8c2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:05.776321 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ad58a-ac01-4643-ac0c-a1329bb8c2f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:05.777037 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ad58a-ac01-4643-ac0c-a1329bb8c2f3 None admin] RBAC: Adding query filter params (role.id=5609ac7373ba400593bba6d811e3aa72, scope.project.id=2cd599a81e8043bebfca960673e63bbc, user.id=e72796c5d7864bd8887419c60e3bbc1b) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:07:05.777344 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ad58a-ac01-4643-ac0c-a1329bb8c2f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:05.778785 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ad58a-ac01-4643-ac0c-a1329bb8c2f3 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:05.784379 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 457/908] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Sep 13 12:07:05 2022] GET /identity/v3/role_assignments?user.id=e72796c5d7864bd8887419c60e3bbc1b&scope.project.id=2cd599a81e8043bebfca960673e63bbc&role.id=5609ac7373ba400593bba6d811e3aa72 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:07:08.262680 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11718c-453e-4583-aaf8-0b9dd9c419e0 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:08.263337 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11718c-453e-4583-aaf8-0b9dd9c419e0 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:08.263337 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11718c-453e-4583-aaf8-0b9dd9c419e0 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:08.264602 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 452/909] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:07:08.270528 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f6967-d0dc-46d1-b66e-7d69dd9cd89b None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:08.271147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f6967-d0dc-46d1-b66e-7d69dd9cd89b None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:08.271147 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f6967-d0dc-46d1-b66e-7d69dd9cd89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:08.295497 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-4d9f6967-d0dc-46d1-b66e-7d69dd9cd89b None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:07:08.296733 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-4d9f6967-d0dc-46d1-b66e-7d69dd9cd89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:07:08.329707 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:07:08.375280 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 458/910] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:07:08 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 12:07:08.697355 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11718c-453e-4583-aaf8-0b9dd9c419e0 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:08.801566 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11718c-453e-4583-aaf8-0b9dd9c419e0 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:08.809815 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:07:08.837351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d131f03-2c64-4e6d-b4dc-20addd401405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:08.838085 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d131f03-2c64-4e6d-b4dc-20addd401405 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:08.838359 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d131f03-2c64-4e6d-b4dc-20addd401405 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:08.838669 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d131f03-2c64-4e6d-b4dc-20addd401405 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:08.839241 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d131f03-2c64-4e6d-b4dc-20addd401405 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:08.840606 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d131f03-2c64-4e6d-b4dc-20addd401405 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:08.849508 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-8d131f03-2c64-4e6d-b4dc-20addd401405 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:07:08.849508 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:07:08.849508 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:07:08.849508 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:07:08.849508 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:07:08.849508 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:07:08.849508 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:07:08.849508 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:07:08.849508 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:07:08.849508 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:07:08.849508 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:07:08.849508 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:07:08.849508 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:07:08.849508 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:07:08.849508 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:07:08.849508 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:07:08.849508 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:07:08.850754 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:07:08.850754 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:07:08.850754 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:07:08.850754 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:07:08.850754 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:07:08.850754 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:07:08.850754 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:07:08.850754 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:07:08.850754 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:07:08.850754 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:07:08.850754 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:07:08.850754 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:07:08.850754 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:07:08.850754 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:07:08.850754 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:07:08.850754 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:07:08.851603 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:07:08.851603 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:07:08.851603 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:07:08.851603 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:07:08.851603 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:07:08.851603 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:07:08.851603 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:07:08.851603 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:07:08.851603 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:07:08.851603 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:07:08.851603 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:07:08.851603 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:07:08.851603 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:07:08.851603 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:07:08.851603 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 453/911] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Sep 13 12:07:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:07:08.856926 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f6967-d0dc-46d1-b66e-7d69dd9cd89b None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:08.958466 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f6967-d0dc-46d1-b66e-7d69dd9cd89b None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:08.995142 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067f117-5d8d-4a94-8722-8bd21be59b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:08.995142 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067f117-5d8d-4a94-8722-8bd21be59b8d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:08.995142 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067f117-5d8d-4a94-8722-8bd21be59b8d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:08.995142 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067f117-5d8d-4a94-8722-8bd21be59b8d None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:08.995632 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067f117-5d8d-4a94-8722-8bd21be59b8d None admin] RBAC: Adding query filter params (name=placement) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:07:08.995836 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067f117-5d8d-4a94-8722-8bd21be59b8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:08.997198 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067f117-5d8d-4a94-8722-8bd21be59b8d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:09.002247 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 459/912] 10.222.0.15 () {56 vars in 1116 bytes} [Tue Sep 13 12:07:08 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:07:09.008278 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d131f03-2c64-4e6d-b4dc-20addd401405 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:09.111691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d131f03-2c64-4e6d-b4dc-20addd401405 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:09.147474 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473140e-6a85-4fb6-abd1-ca9548a545b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:09.148403 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473140e-6a85-4fb6-abd1-ca9548a545b5 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:09.148825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473140e-6a85-4fb6-abd1-ca9548a545b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:09.149102 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473140e-6a85-4fb6-abd1-ca9548a545b5 None admin] PATH_INFO: `/v3/services` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:09.149743 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473140e-6a85-4fb6-abd1-ca9548a545b5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:07:09.150209 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473140e-6a85-4fb6-abd1-ca9548a545b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:09.151650 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473140e-6a85-4fb6-abd1-ca9548a545b5 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:09.156265 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 454/913] 10.222.0.15 () {56 vars in 1116 bytes} [Tue Sep 13 12:07:09 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:07:11.590335 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797ed06-3b99-47bb-9692-1e6eb293da32 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:11.590947 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797ed06-3b99-47bb-9692-1e6eb293da32 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:11.590947 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797ed06-3b99-47bb-9692-1e6eb293da32 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:11.592246 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 460/914] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:07:11.597665 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca910f9-9965-45c8-bf0d-fb252314356c None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:11.598122 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca910f9-9965-45c8-bf0d-fb252314356c None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:11.598228 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca910f9-9965-45c8-bf0d-fb252314356c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:11.617131 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-2ca910f9-9965-45c8-bf0d-fb252314356c None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:07:11.618318 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-2ca910f9-9965-45c8-bf0d-fb252314356c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:07:11.645663 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:07:11.689277 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 455/915] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:07:11 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:07:12.017830 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797ed06-3b99-47bb-9692-1e6eb293da32 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:12.051895 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:07:12.126441 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797ed06-3b99-47bb-9692-1e6eb293da32 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:12.164141 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80d600-6e25-4e56-a103-683157f329a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:12.164745 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80d600-6e25-4e56-a103-683157f329a8 None admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:12.165018 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80d600-6e25-4e56-a103-683157f329a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:12.165312 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80d600-6e25-4e56-a103-683157f329a8 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:12.165957 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80d600-6e25-4e56-a103-683157f329a8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:12.167331 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80d600-6e25-4e56-a103-683157f329a8 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:12.182701 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 461/916] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Sep 13 12:07:12 2022] POST /identity/v3/services => generated 246 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:07:14.648889 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc3456-8ed9-411d-b367-caf0ac43eaed None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:14.649427 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc3456-8ed9-411d-b367-caf0ac43eaed None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:14.649545 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc3456-8ed9-411d-b367-caf0ac43eaed None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:14.651065 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 456/917] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:07:14.656534 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559e3cb-568b-49b3-8fbc-29fcc6aa72f8 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:14.656975 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559e3cb-568b-49b3-8fbc-29fcc6aa72f8 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:14.657085 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559e3cb-568b-49b3-8fbc-29fcc6aa72f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:14.675970 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-3559e3cb-568b-49b3-8fbc-29fcc6aa72f8 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:07:14.677211 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-3559e3cb-568b-49b3-8fbc-29fcc6aa72f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:07:14.753336 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 462/918] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:07:14 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:07:15.085883 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc3456-8ed9-411d-b367-caf0ac43eaed None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:15.193248 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc3456-8ed9-411d-b367-caf0ac43eaed None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:15.233290 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83029330-ff48-4037-925c-6ab58e0e8fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:15.233917 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83029330-ff48-4037-925c-6ab58e0e8fb1 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:15.234196 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83029330-ff48-4037-925c-6ab58e0e8fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:15.234472 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83029330-ff48-4037-925c-6ab58e0e8fb1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:15.235090 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83029330-ff48-4037-925c-6ab58e0e8fb1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:15.236463 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83029330-ff48-4037-925c-6ab58e0e8fb1 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:15.246450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-83029330-ff48-4037-925c-6ab58e0e8fb1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:07:15.246450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:07:15.246450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:07:15.246450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:07:15.246450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:07:15.246450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:07:15.246450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:07:15.246450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:07:15.246450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:07:15.246450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:07:15.246450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:07:15.246450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:07:15.246450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:07:15.246450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:07:15.246450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:07:15.246450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:07:15.246450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:07:15.247673 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:07:15.247673 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:07:15.247673 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:07:15.247673 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:07:15.247673 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:07:15.247673 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:07:15.247673 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:07:15.247673 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:07:15.247673 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:07:15.247673 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:07:15.247673 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:07:15.247673 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:07:15.247673 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:07:15.247673 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:07:15.247673 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:07:15.247673 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:07:15.248532 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:07:15.248532 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:07:15.248532 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:07:15.248532 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:07:15.248532 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:07:15.248532 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:07:15.248532 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:07:15.248532 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:07:15.248532 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:07:15.248532 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:07:15.248532 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:07:15.248532 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:07:15.248532 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:07:15.248532 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:07:15.248532 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 457/919] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Sep 13 12:07:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:07:15.253643 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559e3cb-568b-49b3-8fbc-29fcc6aa72f8 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:15.272184 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:07:15.358564 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559e3cb-568b-49b3-8fbc-29fcc6aa72f8 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:15.391652 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf209e-a1bf-450e-b34b-ca2db86f7c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:15.392252 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf209e-a1bf-450e-b34b-ca2db86f7c56 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:15.392532 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf209e-a1bf-450e-b34b-ca2db86f7c56 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:15.392807 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf209e-a1bf-450e-b34b-ca2db86f7c56 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:15.393438 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf209e-a1bf-450e-b34b-ca2db86f7c56 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:07:15.393743 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf209e-a1bf-450e-b34b-ca2db86f7c56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:15.395146 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf209e-a1bf-450e-b34b-ca2db86f7c56 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:15.400951 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 463/920] 10.222.0.15 () {56 vars in 1116 bytes} [Tue Sep 13 12:07:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:07:15.407237 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83029330-ff48-4037-925c-6ab58e0e8fb1 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:15.438015 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:07:15.512229 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83029330-ff48-4037-925c-6ab58e0e8fb1 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:15.549355 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2bc02d-0293-4454-8560-e147ec2a8693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:15.549961 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bc02d-0293-4454-8560-e147ec2a8693 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:15.550242 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bc02d-0293-4454-8560-e147ec2a8693 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:15.550518 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bc02d-0293-4454-8560-e147ec2a8693 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:15.551271 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2bc02d-0293-4454-8560-e147ec2a8693 None admin] RBAC: Adding query filter params (interface=public, service_id=81a1fe2dd4804b5c892c5c617bfa427f, region_id=RegionOne) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:07:15.551582 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2bc02d-0293-4454-8560-e147ec2a8693 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:15.552952 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2bc02d-0293-4454-8560-e147ec2a8693 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:15.558266 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 458/921] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Sep 13 12:07:15 2022] GET /identity/v3/endpoints?service_id=81a1fe2dd4804b5c892c5c617bfa427f&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:07:15.564836 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf209e-a1bf-450e-b34b-ca2db86f7c56 None admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:15.656889 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:07:15.676497 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf209e-a1bf-450e-b34b-ca2db86f7c56 None admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:15.712919 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9012e2-3bef-4cc7-9a51-180bfb51f91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:15.713603 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9012e2-3bef-4cc7-9a51-180bfb51f91d None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:15.713877 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9012e2-3bef-4cc7-9a51-180bfb51f91d None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:15.714142 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9012e2-3bef-4cc7-9a51-180bfb51f91d None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:15.714768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9012e2-3bef-4cc7-9a51-180bfb51f91d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:15.716116 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9012e2-3bef-4cc7-9a51-180bfb51f91d None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:15.723811 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 464/922] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Sep 13 12:07:15 2022] GET /identity/v3/services => generated 1962 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:07:18.153762 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235015f7-c366-4705-a483-4fad30c8c3dc None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:18.154332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235015f7-c366-4705-a483-4fad30c8c3dc None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:18.154332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235015f7-c366-4705-a483-4fad30c8c3dc None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:18.155679 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 459/923] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:07:18.161283 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27227a4-0c3a-4887-bd9b-245937d0a608 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:18.161732 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27227a4-0c3a-4887-bd9b-245937d0a608 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:18.161824 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27227a4-0c3a-4887-bd9b-245937d0a608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:18.181790 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-a27227a4-0c3a-4887-bd9b-245937d0a608 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:07:18.183201 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-a27227a4-0c3a-4887-bd9b-245937d0a608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:07:18.251917 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 465/924] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:07:18 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 12:07:18.575206 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235015f7-c366-4705-a483-4fad30c8c3dc None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:18.679521 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:07:18.689701 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235015f7-c366-4705-a483-4fad30c8c3dc None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:18.726310 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f05ff-3b68-4320-8a26-60d404d7e1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:18.726968 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f05ff-3b68-4320-8a26-60d404d7e1a1 None admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:18.727310 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f05ff-3b68-4320-8a26-60d404d7e1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:18.727629 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f05ff-3b68-4320-8a26-60d404d7e1a1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:18.728409 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f05ff-3b68-4320-8a26-60d404d7e1a1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:18.729781 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f05ff-3b68-4320-8a26-60d404d7e1a1 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:18.739546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application [None req-7c8f05ff-3b68-4320-8a26-60d404d7e1a1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:07:18.739546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:07:18.739546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 12:07:18.739546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 12:07:18.739546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 12:07:18.739546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 12:07:18.739546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 12:07:18.739546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:07:18.739546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:07:18.739546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:07:18.739546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 12:07:18.739546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:07:18.739546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 12:07:18.739546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 12:07:18.739546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 12:07:18.739546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 12:07:18.739546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 12:07:18.740716 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 12:07:18.740716 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 12:07:18.740716 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 12:07:18.740716 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 12:07:18.740716 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 12:07:18.740716 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 12:07:18.740716 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 12:07:18.740716 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 12:07:18.740716 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 12:07:18.740716 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 12:07:18.740716 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 12:07:18.740716 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 12:07:18.740716 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 12:07:18.740716 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 12:07:18.740716 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 12:07:18.740716 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 12:07:18.741891 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 12:07:18.741891 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application with Lock( Sep 13 12:07:18.741891 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 12:07:18.741891 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self._enter() Sep 13 12:07:18.741891 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 12:07:18.741891 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 12:07:18.741891 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 12:07:18.741891 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application return self.creator() Sep 13 12:07:18.741891 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 12:07:18.741891 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application created_value = creator( Sep 13 12:07:18.741891 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 12:07:18.741891 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 12:07:18.741891 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 12:07:18.741891 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: ERROR keystone.server.flask.application Sep 13 12:07:18.741891 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 460/925] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Sep 13 12:07:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 12:07:18.746867 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27227a4-0c3a-4887-bd9b-245937d0a608 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:18.826319 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:07:18.850230 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27227a4-0c3a-4887-bd9b-245937d0a608 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:18.884495 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d1cb1-fa8c-41d7-9b18-8cb1c0073488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:18.885100 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d1cb1-fa8c-41d7-9b18-8cb1c0073488 None admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:18.885367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d1cb1-fa8c-41d7-9b18-8cb1c0073488 None admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:18.885632 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d1cb1-fa8c-41d7-9b18-8cb1c0073488 None admin] PATH_INFO: `/v3/services` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:18.886262 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d1cb1-fa8c-41d7-9b18-8cb1c0073488 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:07:18.886559 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d1cb1-fa8c-41d7-9b18-8cb1c0073488 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:18.887929 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d1cb1-fa8c-41d7-9b18-8cb1c0073488 None admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:18.893420 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 466/926] 10.222.0.15 () {56 vars in 1116 bytes} [Tue Sep 13 12:07:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:07:18.900044 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f05ff-3b68-4320-8a26-60d404d7e1a1 None admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:07:19.001653 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f05ff-3b68-4320-8a26-60d404d7e1a1 None admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:07:19.037359 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1bd1e-fe9e-4d8c-a1f2-35c62d794a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:07:19.037990 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1bd1e-fe9e-4d8c-a1f2-35c62d794a56 None admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:07:19.038573 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1bd1e-fe9e-4d8c-a1f2-35c62d794a56 None admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:07:19.038881 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1bd1e-fe9e-4d8c-a1f2-35c62d794a56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:07:19.039555 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1bd1e-fe9e-4d8c-a1f2-35c62d794a56 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:07:19.041172 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1bd1e-fe9e-4d8c-a1f2-35c62d794a56 None admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:07:19.063640 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 461/927] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Sep 13 12:07:18 2022] POST /identity/v3/endpoints => generated 331 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:07:28.890325 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=30 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:07:29.059962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:22.289963 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81a9c9-738b-4699-8250-83cb3aceee39 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:22.290534 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81a9c9-738b-4699-8250-83cb3aceee39 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:22.290534 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81a9c9-738b-4699-8250-83cb3aceee39 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:22.292086 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 467/928] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:22.297878 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77c18f-44cf-4628-abfc-4bf6dc72bbe3 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:22.298407 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77c18f-44cf-4628-abfc-4bf6dc72bbe3 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:22.298407 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77c18f-44cf-4628-abfc-4bf6dc72bbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:22.319089 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-9e77c18f-44cf-4628-abfc-4bf6dc72bbe3 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:22.320324 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-9e77c18f-44cf-4628-abfc-4bf6dc72bbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:22.407532 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 462/929] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:08:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:08:22.762117 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526992d-b3e2-4340-9c63-baad9a745bf1 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:22.762493 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526992d-b3e2-4340-9c63-baad9a745bf1 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:22.762977 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526992d-b3e2-4340-9c63-baad9a745bf1 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:22.764391 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 468/930] 10.222.0.15 () {54 vars in 965 bytes} [Tue Sep 13 12:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:22.771592 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900abf6f-cbf3-48e6-b945-09d1818286bd None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:22.771992 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900abf6f-cbf3-48e6-b945-09d1818286bd None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:22.773080 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900abf6f-cbf3-48e6-b945-09d1818286bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:22.830855 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-900abf6f-cbf3-48e6-b945-09d1818286bd None None] MFA Rules not processed for user `2e24fc5713164917ba1368ff461e9629`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:22.832593 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-900abf6f-cbf3-48e6-b945-09d1818286bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:22.906887 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 463/931] 10.222.0.15 () {58 vars in 1062 bytes} [Tue Sep 13 12:08:22 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:08:22.916625 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526992d-b3e2-4340-9c63-baad9a745bf1 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:08:22.927490 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526992d-b3e2-4340-9c63-baad9a745bf1 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:08:22.930988 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc8eba-b74d-4634-a20b-b29eaa0b6a23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:08:22.931606 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc8eba-b74d-4634-a20b-b29eaa0b6a23 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:22.931909 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc8eba-b74d-4634-a20b-b29eaa0b6a23 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:22.932185 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc8eba-b74d-4634-a20b-b29eaa0b6a23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:22.942133 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc8eba-b74d-4634-a20b-b29eaa0b6a23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:08:22.943660 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc8eba-b74d-4634-a20b-b29eaa0b6a23 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:08:22.954516 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 469/932] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:08:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:08:25.726282 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fc459-a5b8-44b5-bfdf-37b68c5b6aab None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:25.726838 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fc459-a5b8-44b5-bfdf-37b68c5b6aab None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:25.726929 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fc459-a5b8-44b5-bfdf-37b68c5b6aab None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:25.728190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 464/933] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:25.733627 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e914571-7d31-41da-8b92-0884301e05a4 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:25.734080 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e914571-7d31-41da-8b92-0884301e05a4 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:25.734169 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e914571-7d31-41da-8b92-0884301e05a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:25.754157 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-1e914571-7d31-41da-8b92-0884301e05a4 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:25.755824 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-1e914571-7d31-41da-8b92-0884301e05a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:25.764025 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 470/934] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:08:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:08:26.102608 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fc459-a5b8-44b5-bfdf-37b68c5b6aab None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:08:26.114983 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fc459-a5b8-44b5-bfdf-37b68c5b6aab None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:08:26.118488 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dddaf-f1bb-47c5-9533-4f7693b74ba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:08:26.119130 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dddaf-f1bb-47c5-9533-4f7693b74ba9 service neutron] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:26.119402 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dddaf-f1bb-47c5-9533-4f7693b74ba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:26.119672 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dddaf-f1bb-47c5-9533-4f7693b74ba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:26.130170 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7dddaf-f1bb-47c5-9533-4f7693b74ba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:08:26.131661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7dddaf-f1bb-47c5-9533-4f7693b74ba9 service neutron] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:08:26.142233 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 465/935] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:08:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:08:28.971032 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11982aec-3e3c-49b1-8386-d2bf50387099 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:28.971550 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11982aec-3e3c-49b1-8386-d2bf50387099 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:28.971550 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11982aec-3e3c-49b1-8386-d2bf50387099 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:28.975047 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 471/936] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:08:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:28.979251 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae442c-7e59-4891-8047-b332244abd49 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:28.979784 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae442c-7e59-4891-8047-b332244abd49 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:28.979784 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae442c-7e59-4891-8047-b332244abd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:29.038351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-85ae442c-7e59-4891-8047-b332244abd49 None None] MFA Rules not processed for user `202e3f4635df4dfca22906fc29c21b69`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:29.040308 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-85ae442c-7e59-4891-8047-b332244abd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:29.097659 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:29.135798 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 466/937] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:08:28 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:08:29.483247 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11982aec-3e3c-49b1-8386-d2bf50387099 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:08:29.496151 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11982aec-3e3c-49b1-8386-d2bf50387099 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:08:29.500058 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764bd12-2800-42d2-aff9-c10975557b5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:08:29.500737 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764bd12-2800-42d2-aff9-c10975557b5c service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:29.500954 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764bd12-2800-42d2-aff9-c10975557b5c service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:29.501225 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764bd12-2800-42d2-aff9-c10975557b5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:29.512371 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764bd12-2800-42d2-aff9-c10975557b5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:08:29.513942 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764bd12-2800-42d2-aff9-c10975557b5c service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:08:29.526453 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 472/938] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:08:29 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:08:32.592489 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35901ae-0061-4138-895c-93c9f20c8468 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:32.592999 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35901ae-0061-4138-895c-93c9f20c8468 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:32.592999 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35901ae-0061-4138-895c-93c9f20c8468 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:32.594281 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 467/939] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:32.599940 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb3301-d4e1-44a6-934e-b1630af728ea None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:32.600393 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb3301-d4e1-44a6-934e-b1630af728ea None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:32.600482 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb3301-d4e1-44a6-934e-b1630af728ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:32.620133 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-1fbb3301-d4e1-44a6-934e-b1630af728ea None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:32.621344 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-1fbb3301-d4e1-44a6-934e-b1630af728ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:32.697293 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 473/940] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:08:32 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:08:33.032593 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35901ae-0061-4138-895c-93c9f20c8468 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:08:33.044359 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35901ae-0061-4138-895c-93c9f20c8468 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:08:33.047734 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3af44-546d-4561-b66a-680d4c2bf852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:08:33.048379 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3af44-546d-4561-b66a-680d4c2bf852 service neutron] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:33.048655 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3af44-546d-4561-b66a-680d4c2bf852 service neutron] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:33.048928 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3af44-546d-4561-b66a-680d4c2bf852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:33.059328 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3af44-546d-4561-b66a-680d4c2bf852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:08:33.060764 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3af44-546d-4561-b66a-680d4c2bf852 service neutron] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:08:33.072248 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 468/941] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:08:33 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:08:36.249569 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf68f3-b8f0-434e-92e6-cb7c64c2e939 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:36.250175 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf68f3-b8f0-434e-92e6-cb7c64c2e939 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:36.250175 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf68f3-b8f0-434e-92e6-cb7c64c2e939 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:36.251467 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 474/942] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:36.257984 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dc91e-1548-4aa6-a706-d5b89ed29f8e None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:36.258509 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dc91e-1548-4aa6-a706-d5b89ed29f8e None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:36.258509 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dc91e-1548-4aa6-a706-d5b89ed29f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:36.283135 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-0d8dc91e-1548-4aa6-a706-d5b89ed29f8e None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:36.284332 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-0d8dc91e-1548-4aa6-a706-d5b89ed29f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:36.293626 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 469/943] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:08:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:08:36.639838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf68f3-b8f0-434e-92e6-cb7c64c2e939 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:08:36.650657 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf68f3-b8f0-434e-92e6-cb7c64c2e939 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:08:36.654192 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e075a-36ac-456e-9b58-0ff5736c3231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:08:36.654953 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e075a-36ac-456e-9b58-0ff5736c3231 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:36.655252 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e075a-36ac-456e-9b58-0ff5736c3231 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:36.655526 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e075a-36ac-456e-9b58-0ff5736c3231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:36.667840 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e075a-36ac-456e-9b58-0ff5736c3231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:08:36.667840 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e075a-36ac-456e-9b58-0ff5736c3231 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:08:36.678768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 475/944] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:08:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:08:39.217554 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41b0a6-c7ca-481a-b201-12324e3cc1c1 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:39.218166 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41b0a6-c7ca-481a-b201-12324e3cc1c1 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:39.218166 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41b0a6-c7ca-481a-b201-12324e3cc1c1 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:39.219559 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 470/945] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:39.225927 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743120f-38bd-4b8b-b95d-d170ef48d996 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:39.226407 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743120f-38bd-4b8b-b95d-d170ef48d996 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:39.226533 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743120f-38bd-4b8b-b95d-d170ef48d996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:39.247121 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-5743120f-38bd-4b8b-b95d-d170ef48d996 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:39.248339 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-5743120f-38bd-4b8b-b95d-d170ef48d996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:39.256563 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 476/946] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:08:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:08:39.599932 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41b0a6-c7ca-481a-b201-12324e3cc1c1 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:08:39.610716 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41b0a6-c7ca-481a-b201-12324e3cc1c1 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:08:39.614394 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd0bef-cc74-4c68-9cfb-60ad6988bcb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:08:39.615024 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd0bef-cc74-4c68-9cfb-60ad6988bcb6 service neutron] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:39.615307 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd0bef-cc74-4c68-9cfb-60ad6988bcb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:39.615581 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd0bef-cc74-4c68-9cfb-60ad6988bcb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:39.625054 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd0bef-cc74-4c68-9cfb-60ad6988bcb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:08:39.626481 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd0bef-cc74-4c68-9cfb-60ad6988bcb6 service neutron] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:08:39.637544 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 471/947] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:08:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:08:42.324517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabc50b-e433-469b-9050-add36adefbfe None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:42.325071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabc50b-e433-469b-9050-add36adefbfe None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:42.325071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabc50b-e433-469b-9050-add36adefbfe None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:42.326399 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 477/948] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:42.332691 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8453992-732e-4233-99a8-db6bc73d7762 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:42.333209 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8453992-732e-4233-99a8-db6bc73d7762 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:42.333316 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8453992-732e-4233-99a8-db6bc73d7762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:42.353442 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-d8453992-732e-4233-99a8-db6bc73d7762 None None] MFA Rules not processed for user `202e3f4635df4dfca22906fc29c21b69`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:42.354657 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-d8453992-732e-4233-99a8-db6bc73d7762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:42.362837 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 472/949] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:08:42 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:08:42.723031 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27314643-4da1-4679-bb61-77a8fb159a73 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:42.723488 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27314643-4da1-4679-bb61-77a8fb159a73 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:42.723832 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27314643-4da1-4679-bb61-77a8fb159a73 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:42.725251 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 478/950] 10.222.0.15 () {54 vars in 965 bytes} [Tue Sep 13 12:08:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:42.731839 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63566bdf-a1ba-445d-b15e-c1821aac5fcf None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:42.732146 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63566bdf-a1ba-445d-b15e-c1821aac5fcf None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:42.732419 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63566bdf-a1ba-445d-b15e-c1821aac5fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:42.753394 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-63566bdf-a1ba-445d-b15e-c1821aac5fcf None None] MFA Rules not processed for user `2e24fc5713164917ba1368ff461e9629`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:42.754587 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-63566bdf-a1ba-445d-b15e-c1821aac5fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:42.761024 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 473/951] 10.222.0.15 () {58 vars in 1062 bytes} [Tue Sep 13 12:08:42 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:08:42.770373 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27314643-4da1-4679-bb61-77a8fb159a73 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:08:42.781278 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27314643-4da1-4679-bb61-77a8fb159a73 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:08:42.785963 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b412995-c200-44b3-afb1-0238f3d2c35d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:08:42.786560 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b412995-c200-44b3-afb1-0238f3d2c35d service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:42.786870 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b412995-c200-44b3-afb1-0238f3d2c35d service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:42.787142 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b412995-c200-44b3-afb1-0238f3d2c35d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:42.796456 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b412995-c200-44b3-afb1-0238f3d2c35d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:08:42.797887 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b412995-c200-44b3-afb1-0238f3d2c35d service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:08:42.808231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 479/952] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:08:42 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:08:45.948844 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f45a5-814e-4389-9cf6-81a1fbc1bb1a None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:45.949354 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f45a5-814e-4389-9cf6-81a1fbc1bb1a None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:45.949354 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f45a5-814e-4389-9cf6-81a1fbc1bb1a None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:45.950604 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 474/953] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:45.956538 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71ba8f-a70c-4b26-83f7-23c69aed8c0d None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:45.957407 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71ba8f-a70c-4b26-83f7-23c69aed8c0d None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:45.957687 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71ba8f-a70c-4b26-83f7-23c69aed8c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:45.978018 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-3d71ba8f-a70c-4b26-83f7-23c69aed8c0d None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:45.979258 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-3d71ba8f-a70c-4b26-83f7-23c69aed8c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:45.987839 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 480/954] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:08:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:08:46.339419 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f45a5-814e-4389-9cf6-81a1fbc1bb1a None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:08:46.350485 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f45a5-814e-4389-9cf6-81a1fbc1bb1a None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:08:46.354285 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8380219-0727-44e1-bdd6-69d5dc367594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:08:46.354923 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8380219-0727-44e1-bdd6-69d5dc367594 service neutron] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:46.355208 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8380219-0727-44e1-bdd6-69d5dc367594 service neutron] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:46.355481 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8380219-0727-44e1-bdd6-69d5dc367594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:46.365964 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8380219-0727-44e1-bdd6-69d5dc367594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:08:46.367448 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8380219-0727-44e1-bdd6-69d5dc367594 service neutron] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:08:46.378893 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 475/955] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:08:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:08:48.936534 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e8b5c-0510-4cbd-b7e9-5ac8269f9b57 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:48.937059 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e8b5c-0510-4cbd-b7e9-5ac8269f9b57 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:48.937059 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e8b5c-0510-4cbd-b7e9-5ac8269f9b57 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:48.939499 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 481/956] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:08:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:08:48.945407 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98c455-b66c-4047-b48c-e749dc7e769e None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:48.945853 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98c455-b66c-4047-b48c-e749dc7e769e None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:48.945941 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98c455-b66c-4047-b48c-e749dc7e769e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:48.965828 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-6e98c455-b66c-4047-b48c-e749dc7e769e None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:48.967078 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-6e98c455-b66c-4047-b48c-e749dc7e769e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:48.976752 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 476/957] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:08:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:08:49.318366 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e8b5c-0510-4cbd-b7e9-5ac8269f9b57 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:08:49.323942 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=65 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:08:49.330087 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e8b5c-0510-4cbd-b7e9-5ac8269f9b57 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:08:49.334462 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0620ff-fae6-4bf9-b48d-f36daca98dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:08:49.335096 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0620ff-fae6-4bf9-b48d-f36daca98dff service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:49.335369 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0620ff-fae6-4bf9-b48d-f36daca98dff service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:49.335637 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0620ff-fae6-4bf9-b48d-f36daca98dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:49.346003 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0620ff-fae6-4bf9-b48d-f36daca98dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:08:49.347509 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0620ff-fae6-4bf9-b48d-f36daca98dff service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:08:49.358116 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 482/958] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:08:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:08:52.327863 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7188ee-f837-4ee4-b6f7-c2fbace2bd80 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:52.328435 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7188ee-f837-4ee4-b6f7-c2fbace2bd80 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:52.328435 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7188ee-f837-4ee4-b6f7-c2fbace2bd80 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:52.329735 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 477/959] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:52.335654 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed8ced-b125-473e-bfed-c7667cc57f19 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:52.336107 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed8ced-b125-473e-bfed-c7667cc57f19 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:52.336217 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed8ced-b125-473e-bfed-c7667cc57f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:52.357209 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-99ed8ced-b125-473e-bfed-c7667cc57f19 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:52.358431 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-99ed8ced-b125-473e-bfed-c7667cc57f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:52.366640 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 483/960] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:08:52 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:08:52.704512 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7188ee-f837-4ee4-b6f7-c2fbace2bd80 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:08:52.716014 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7188ee-f837-4ee4-b6f7-c2fbace2bd80 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:08:52.719477 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c0b90-8617-45b3-8700-f2af59f120fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:08:52.720062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c0b90-8617-45b3-8700-f2af59f120fc service neutron] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:52.720339 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c0b90-8617-45b3-8700-f2af59f120fc service neutron] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:52.720609 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c0b90-8617-45b3-8700-f2af59f120fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:52.730324 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c0b90-8617-45b3-8700-f2af59f120fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:08:52.731834 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c0b90-8617-45b3-8700-f2af59f120fc service neutron] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:08:52.742128 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 478/961] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:08:52 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:08:57.390033 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87635f8-36fe-41cf-aebd-e6b7e0ed5a25 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:57.390649 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87635f8-36fe-41cf-aebd-e6b7e0ed5a25 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:57.390649 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87635f8-36fe-41cf-aebd-e6b7e0ed5a25 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:57.391975 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 484/962] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:08:57.398383 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de987eb-1477-42b3-ab54-e3cd1248705a None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:57.398909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de987eb-1477-42b3-ab54-e3cd1248705a None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:57.399012 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de987eb-1477-42b3-ab54-e3cd1248705a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:57.418912 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-3de987eb-1477-42b3-ab54-e3cd1248705a None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:08:57.420122 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-3de987eb-1477-42b3-ab54-e3cd1248705a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:08:57.433541 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 479/963] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:08:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:08:57.787466 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87635f8-36fe-41cf-aebd-e6b7e0ed5a25 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:08:57.798392 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87635f8-36fe-41cf-aebd-e6b7e0ed5a25 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:08:57.802362 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65556c-1a24-43a2-8777-77fbe7fd3018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:08:57.803017 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65556c-1a24-43a2-8777-77fbe7fd3018 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:08:57.803290 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65556c-1a24-43a2-8777-77fbe7fd3018 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:08:57.803557 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65556c-1a24-43a2-8777-77fbe7fd3018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:08:57.812891 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65556c-1a24-43a2-8777-77fbe7fd3018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:08:57.814310 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65556c-1a24-43a2-8777-77fbe7fd3018 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:08:57.825485 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 485/964] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:08:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:00.942564 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e65c5b-957d-4829-9f5d-e3f8ff311ba5 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:00.943136 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e65c5b-957d-4829-9f5d-e3f8ff311ba5 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:00.943136 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e65c5b-957d-4829-9f5d-e3f8ff311ba5 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:00.944470 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 480/965] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:09:00.949811 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e17b8-e733-47a0-97b0-ab571e0d684f None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:00.950398 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e17b8-e733-47a0-97b0-ab571e0d684f None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:00.950398 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e17b8-e733-47a0-97b0-ab571e0d684f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:00.970115 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-b29e17b8-e733-47a0-97b0-ab571e0d684f None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:00.972207 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-b29e17b8-e733-47a0-97b0-ab571e0d684f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:00.982437 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 486/966] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:00 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:09:01.325627 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e65c5b-957d-4829-9f5d-e3f8ff311ba5 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:01.332077 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=51 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:01.339972 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e65c5b-957d-4829-9f5d-e3f8ff311ba5 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:01.343600 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eaca36-da96-4642-906c-ebdd268ae8e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:01.344197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaca36-da96-4642-906c-ebdd268ae8e0 service neutron] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:01.344484 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaca36-da96-4642-906c-ebdd268ae8e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:01.344759 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaca36-da96-4642-906c-ebdd268ae8e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:01.356466 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eaca36-da96-4642-906c-ebdd268ae8e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:01.356660 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eaca36-da96-4642-906c-ebdd268ae8e0 service neutron] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:01.367708 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 481/967] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:01 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:09:05.977480 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd0eaa-4539-41a3-971a-4d396f6b0e75 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:05.978031 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd0eaa-4539-41a3-971a-4d396f6b0e75 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:05.978031 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd0eaa-4539-41a3-971a-4d396f6b0e75 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:05.979312 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 487/968] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:05.984977 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82981be-99c1-4b51-b24d-a7ced26b6e26 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:05.985479 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82981be-99c1-4b51-b24d-a7ced26b6e26 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:05.985659 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82981be-99c1-4b51-b24d-a7ced26b6e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:06.009036 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-f82981be-99c1-4b51-b24d-a7ced26b6e26 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:06.010233 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-f82981be-99c1-4b51-b24d-a7ced26b6e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:06.019870 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 482/969] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:06.365416 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd0eaa-4539-41a3-971a-4d396f6b0e75 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:06.376541 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd0eaa-4539-41a3-971a-4d396f6b0e75 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:06.380974 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71794b-b830-42f9-a8c0-4bb0083a6151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:06.381569 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71794b-b830-42f9-a8c0-4bb0083a6151 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:06.381843 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71794b-b830-42f9-a8c0-4bb0083a6151 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:06.382111 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71794b-b830-42f9-a8c0-4bb0083a6151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:06.393090 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71794b-b830-42f9-a8c0-4bb0083a6151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:06.395395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71794b-b830-42f9-a8c0-4bb0083a6151 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:06.409550 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 488/970] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:12.342389 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868c378-cbd7-46f4-97ab-667f5abd6c6b None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:12.342960 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868c378-cbd7-46f4-97ab-667f5abd6c6b None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:12.342960 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868c378-cbd7-46f4-97ab-667f5abd6c6b None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:12.348445 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 483/971] 10.222.0.15 () {54 vars in 921 bytes} [Tue Sep 13 12:09:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:12.363575 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea14630-eeb0-4460-8d02-d4c128b4b5b6 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:12.365032 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea14630-eeb0-4460-8d02-d4c128b4b5b6 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:12.365453 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea14630-eeb0-4460-8d02-d4c128b4b5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:12.427548 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-fea14630-eeb0-4460-8d02-d4c128b4b5b6 None None] MFA Rules not processed for user `e72796c5d7864bd8887419c60e3bbc1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:12.429079 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-fea14630-eeb0-4460-8d02-d4c128b4b5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:12.514365 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 489/972] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Sep 13 12:09:12 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:09:16.003911 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=8 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:17.476587 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd590eef-36ac-48eb-9bbc-e86981df2a5e None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:17.477273 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd590eef-36ac-48eb-9bbc-e86981df2a5e None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:17.477273 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd590eef-36ac-48eb-9bbc-e86981df2a5e None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:17.478482 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 484/973] 10.222.0.15 () {54 vars in 921 bytes} [Tue Sep 13 12:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:17.484134 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98aa68a-df2c-4fbc-96ba-b442169f1762 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:17.484661 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98aa68a-df2c-4fbc-96ba-b442169f1762 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:17.484661 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98aa68a-df2c-4fbc-96ba-b442169f1762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:17.507556 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-a98aa68a-df2c-4fbc-96ba-b442169f1762 None None] MFA Rules not processed for user `e72796c5d7864bd8887419c60e3bbc1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:17.508866 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-a98aa68a-df2c-4fbc-96ba-b442169f1762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:17.518860 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 490/974] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Sep 13 12:09:17 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:19.151848 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a69b3a-0563-482c-9622-3c05e517cfa0 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:19.152371 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a69b3a-0563-482c-9622-3c05e517cfa0 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:19.152371 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a69b3a-0563-482c-9622-3c05e517cfa0 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:19.153701 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 485/975] 10.222.0.15 () {54 vars in 921 bytes} [Tue Sep 13 12:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:19.158801 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d9968-f747-46b5-b4f1-5b14f85dbd08 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:19.159233 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d9968-f747-46b5-b4f1-5b14f85dbd08 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:19.159340 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d9968-f747-46b5-b4f1-5b14f85dbd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:19.180768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-778d9968-f747-46b5-b4f1-5b14f85dbd08 None None] MFA Rules not processed for user `e72796c5d7864bd8887419c60e3bbc1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:19.182137 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-778d9968-f747-46b5-b4f1-5b14f85dbd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:19.191710 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 491/976] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Sep 13 12:09:19 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:09:23.271697 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13abd6-2f70-4326-8236-a2a2940d1d5f None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:23.272203 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13abd6-2f70-4326-8236-a2a2940d1d5f None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:23.272203 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13abd6-2f70-4326-8236-a2a2940d1d5f None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:23.273847 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 486/977] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:23.279898 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6752284-da2e-4ac0-8800-e1addd9e73ff None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:23.280350 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6752284-da2e-4ac0-8800-e1addd9e73ff None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:23.280633 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6752284-da2e-4ac0-8800-e1addd9e73ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:23.288424 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=69 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:23.301858 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-b6752284-da2e-4ac0-8800-e1addd9e73ff None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:23.303091 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-b6752284-da2e-4ac0-8800-e1addd9e73ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:23.311022 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 492/978] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:23.679266 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a96bfe-258c-4049-9375-abc34605f0f3 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:23.680042 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a96bfe-258c-4049-9375-abc34605f0f3 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:23.680543 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a96bfe-258c-4049-9375-abc34605f0f3 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:23.682443 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 487/979] 10.222.0.15 () {54 vars in 962 bytes} [Tue Sep 13 12:09:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:23.692214 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d144ec-ff4d-43ac-908b-371474a96f30 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:23.692936 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d144ec-ff4d-43ac-908b-371474a96f30 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:23.693620 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d144ec-ff4d-43ac-908b-371474a96f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:23.737994 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-89d144ec-ff4d-43ac-908b-371474a96f30 None None] MFA Rules not processed for user `e740dc7330284b0bbe6a825186f0a55d`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:23.739290 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-89d144ec-ff4d-43ac-908b-371474a96f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:23.817959 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 493/980] 10.222.0.15 () {58 vars in 1059 bytes} [Tue Sep 13 12:09:23 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:23.826254 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a96bfe-258c-4049-9375-abc34605f0f3 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:23.842568 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a96bfe-258c-4049-9375-abc34605f0f3 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:23.848982 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d36853-a21c-4b76-bb18-31eed931292a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:23.849642 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d36853-a21c-4b76-bb18-31eed931292a service nova] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:23.849927 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d36853-a21c-4b76-bb18-31eed931292a service nova] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:23.850201 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d36853-a21c-4b76-bb18-31eed931292a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:23.859620 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d36853-a21c-4b76-bb18-31eed931292a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:23.862157 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d36853-a21c-4b76-bb18-31eed931292a service nova] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:23.873054 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 488/981] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:26.588231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84487653-076d-49e5-9213-25c5845871b8 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:26.588738 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84487653-076d-49e5-9213-25c5845871b8 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:26.588820 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84487653-076d-49e5-9213-25c5845871b8 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:26.590487 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 494/982] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:26.596587 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f70de8-5e8a-4ee7-8420-3c7f0e57ba3c None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:26.597091 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f70de8-5e8a-4ee7-8420-3c7f0e57ba3c None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:26.597091 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f70de8-5e8a-4ee7-8420-3c7f0e57ba3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:26.621692 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-f3f70de8-5e8a-4ee7-8420-3c7f0e57ba3c None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:26.622962 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-f3f70de8-5e8a-4ee7-8420-3c7f0e57ba3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:26.631615 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 489/983] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:26.979621 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84487653-076d-49e5-9213-25c5845871b8 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:26.995419 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84487653-076d-49e5-9213-25c5845871b8 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:27.001257 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15aedf-8a29-456e-9f56-91b321f0fff6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:27.002450 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15aedf-8a29-456e-9f56-91b321f0fff6 service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:27.002898 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15aedf-8a29-456e-9f56-91b321f0fff6 service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:27.003177 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15aedf-8a29-456e-9f56-91b321f0fff6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:27.012458 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15aedf-8a29-456e-9f56-91b321f0fff6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:27.014102 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15aedf-8a29-456e-9f56-91b321f0fff6 service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:27.025171 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 495/984] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:29.926546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ba5f1-c904-4a7c-b065-d6adf0d0505c None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:29.926546 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ba5f1-c904-4a7c-b065-d6adf0d0505c None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:29.927026 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ba5f1-c904-4a7c-b065-d6adf0d0505c None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:29.929426 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 490/985] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:29.934453 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e3831-c0de-4302-b90b-216d781ca919 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:29.934937 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e3831-c0de-4302-b90b-216d781ca919 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:29.935066 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e3831-c0de-4302-b90b-216d781ca919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:29.967673 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-fc4e3831-c0de-4302-b90b-216d781ca919 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:29.968987 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-fc4e3831-c0de-4302-b90b-216d781ca919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:29.978760 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 496/986] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:30.345998 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9af82e-98c7-40d3-85a6-52acda85d474 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:30.346376 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9af82e-98c7-40d3-85a6-52acda85d474 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:30.346707 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9af82e-98c7-40d3-85a6-52acda85d474 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:30.348299 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 491/987] 10.222.0.15 () {54 vars in 962 bytes} [Tue Sep 13 12:09:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:30.355775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc15bcf-fd74-4d47-9b3d-3407c75168f8 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:30.356072 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc15bcf-fd74-4d47-9b3d-3407c75168f8 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:30.356380 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc15bcf-fd74-4d47-9b3d-3407c75168f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:30.382221 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-adc15bcf-fd74-4d47-9b3d-3407c75168f8 None None] MFA Rules not processed for user `e740dc7330284b0bbe6a825186f0a55d`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:30.383540 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-adc15bcf-fd74-4d47-9b3d-3407c75168f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:30.393709 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 497/988] 10.222.0.15 () {58 vars in 1059 bytes} [Tue Sep 13 12:09:30 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:30.406229 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9af82e-98c7-40d3-85a6-52acda85d474 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:30.425162 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9af82e-98c7-40d3-85a6-52acda85d474 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:30.431087 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42378f41-79aa-4a7b-8e02-af6ea2a435b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:30.431881 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42378f41-79aa-4a7b-8e02-af6ea2a435b8 service nova] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:30.432223 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42378f41-79aa-4a7b-8e02-af6ea2a435b8 service nova] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:30.432594 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42378f41-79aa-4a7b-8e02-af6ea2a435b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:30.443795 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42378f41-79aa-4a7b-8e02-af6ea2a435b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:30.445699 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42378f41-79aa-4a7b-8e02-af6ea2a435b8 service nova] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:30.457502 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 492/989] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:33.147727 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5c991-f984-4663-be7b-3f084d3326ad None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:33.148959 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5c991-f984-4663-be7b-3f084d3326ad None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:33.149455 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5c991-f984-4663-be7b-3f084d3326ad None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:33.151280 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 498/990] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:09:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:33.157378 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275ba16-0745-4980-935b-a28193ac1628 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:33.158350 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275ba16-0745-4980-935b-a28193ac1628 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:33.158890 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275ba16-0745-4980-935b-a28193ac1628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:33.179457 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-8275ba16-0745-4980-935b-a28193ac1628 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:33.181101 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-8275ba16-0745-4980-935b-a28193ac1628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:33.197805 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 493/991] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:33.559617 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5c991-f984-4663-be7b-3f084d3326ad None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:33.575555 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5c991-f984-4663-be7b-3f084d3326ad None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:33.581169 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd05267-8964-4b0c-9e7e-3ee562232bef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:33.582058 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd05267-8964-4b0c-9e7e-3ee562232bef service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:33.582557 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd05267-8964-4b0c-9e7e-3ee562232bef service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:33.583066 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd05267-8964-4b0c-9e7e-3ee562232bef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:33.593026 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd05267-8964-4b0c-9e7e-3ee562232bef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:33.595773 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd05267-8964-4b0c-9e7e-3ee562232bef service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:33.623703 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 499/992] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:34.054078 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a71210-b681-4301-ba60-f5c15be490df None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:34.054078 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a71210-b681-4301-ba60-f5c15be490df None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:34.054078 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a71210-b681-4301-ba60-f5c15be490df None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:34.054078 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 494/993] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:09:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:34.063827 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2954ec9-71e8-4e1b-9f22-4a32ff2ec7a7 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:34.063827 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2954ec9-71e8-4e1b-9f22-4a32ff2ec7a7 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:34.063827 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2954ec9-71e8-4e1b-9f22-4a32ff2ec7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:34.104720 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-f2954ec9-71e8-4e1b-9f22-4a32ff2ec7a7 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:34.108667 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-f2954ec9-71e8-4e1b-9f22-4a32ff2ec7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:34.127650 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 500/994] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:09:34.525945 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95930dbe-cc03-4da3-9292-f37eed945e05 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:34.525945 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95930dbe-cc03-4da3-9292-f37eed945e05 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:34.525945 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95930dbe-cc03-4da3-9292-f37eed945e05 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:34.525945 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 495/995] 10.222.0.15 () {54 vars in 964 bytes} [Tue Sep 13 12:09:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:34.534538 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166a7df-dd05-41fd-88f7-5c20329023ee None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:34.534538 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166a7df-dd05-41fd-88f7-5c20329023ee None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:34.534538 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166a7df-dd05-41fd-88f7-5c20329023ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:34.584749 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-0166a7df-dd05-41fd-88f7-5c20329023ee None None] MFA Rules not processed for user `06cb1e39f474441495bc09988786a84a`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:34.586002 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-0166a7df-dd05-41fd-88f7-5c20329023ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:34.674602 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 501/996] 10.222.0.15 () {58 vars in 1061 bytes} [Tue Sep 13 12:09:34 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:34.683198 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95930dbe-cc03-4da3-9292-f37eed945e05 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:34.695302 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95930dbe-cc03-4da3-9292-f37eed945e05 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:34.699898 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b2e43-3275-4e83-8d26-372f56942d49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06cb1e39f474441495bc09988786a84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:34.700852 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b2e43-3275-4e83-8d26-372f56942d49 service cinder] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:34.701384 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b2e43-3275-4e83-8d26-372f56942d49 service cinder] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:34.701871 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b2e43-3275-4e83-8d26-372f56942d49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:34.717424 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b2e43-3275-4e83-8d26-372f56942d49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:34.719929 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b2e43-3275-4e83-8d26-372f56942d49 service cinder] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:34.741258 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 496/997] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:09:36.403516 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde8cc0-aaeb-422e-9942-d25b2910c78a None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:36.404011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde8cc0-aaeb-422e-9942-d25b2910c78a None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:36.404122 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde8cc0-aaeb-422e-9942-d25b2910c78a None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:36.405415 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 502/998] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:36.412311 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab33fc-6970-401d-aaa5-ffa8be5b86fe None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:36.412886 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab33fc-6970-401d-aaa5-ffa8be5b86fe None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:36.412993 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab33fc-6970-401d-aaa5-ffa8be5b86fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:36.433307 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-d2ab33fc-6970-401d-aaa5-ffa8be5b86fe None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:36.434665 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-d2ab33fc-6970-401d-aaa5-ffa8be5b86fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:36.447073 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 497/999] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:09:36.881801 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde8cc0-aaeb-422e-9942-d25b2910c78a None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:36.896411 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde8cc0-aaeb-422e-9942-d25b2910c78a None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:36.901944 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a938c2-e75f-4bb6-bff0-9eed4ce57917 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:36.902887 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a938c2-e75f-4bb6-bff0-9eed4ce57917 service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:36.903167 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a938c2-e75f-4bb6-bff0-9eed4ce57917 service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:36.903443 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a938c2-e75f-4bb6-bff0-9eed4ce57917 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:36.913131 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a938c2-e75f-4bb6-bff0-9eed4ce57917 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:36.914788 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a938c2-e75f-4bb6-bff0-9eed4ce57917 service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:36.919165 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=100 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:36.929205 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 503/1000] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:39.475536 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ef69c-98ff-45c9-9942-78473b93c8b6 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:39.476582 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ef69c-98ff-45c9-9942-78473b93c8b6 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:39.476871 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ef69c-98ff-45c9-9942-78473b93c8b6 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:39.478296 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 498/1001] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:09:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:39.483713 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa7eef-d5d9-42ae-abfb-f435a6e67d97 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:39.484179 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa7eef-d5d9-42ae-abfb-f435a6e67d97 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:39.484262 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa7eef-d5d9-42ae-abfb-f435a6e67d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:39.503587 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-1afa7eef-d5d9-42ae-abfb-f435a6e67d97 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:39.504815 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-1afa7eef-d5d9-42ae-abfb-f435a6e67d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:39.513035 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 504/1002] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:39.860813 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ef69c-98ff-45c9-9942-78473b93c8b6 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:39.874513 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ef69c-98ff-45c9-9942-78473b93c8b6 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:39.880645 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682740d9-82e0-47eb-b729-25fa02be41ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:39.881251 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682740d9-82e0-47eb-b729-25fa02be41ff service nova] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:39.881532 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682740d9-82e0-47eb-b729-25fa02be41ff service nova] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:39.881806 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682740d9-82e0-47eb-b729-25fa02be41ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:39.890820 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682740d9-82e0-47eb-b729-25fa02be41ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:39.893240 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682740d9-82e0-47eb-b729-25fa02be41ff service nova] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:39.903444 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 499/1003] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:42.555574 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e767a1b-fd54-48ec-b833-0f4d2501bb57 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:42.556115 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e767a1b-fd54-48ec-b833-0f4d2501bb57 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:42.556115 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e767a1b-fd54-48ec-b833-0f4d2501bb57 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:42.557451 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 505/1004] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:42.562976 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabef95d-14e6-4f5b-bd72-9e6c01a55d6f None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:42.563802 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabef95d-14e6-4f5b-bd72-9e6c01a55d6f None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:42.564353 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabef95d-14e6-4f5b-bd72-9e6c01a55d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:42.584874 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-cabef95d-14e6-4f5b-bd72-9e6c01a55d6f None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:42.586076 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-cabef95d-14e6-4f5b-bd72-9e6c01a55d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:42.604371 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 500/1005] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:42.953144 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e767a1b-fd54-48ec-b833-0f4d2501bb57 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:42.967297 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e767a1b-fd54-48ec-b833-0f4d2501bb57 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:42.974997 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3cb09c-8e47-44cb-a409-998381ab1681 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:42.975657 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3cb09c-8e47-44cb-a409-998381ab1681 service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:42.975932 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3cb09c-8e47-44cb-a409-998381ab1681 service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:42.976201 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3cb09c-8e47-44cb-a409-998381ab1681 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:42.985716 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3cb09c-8e47-44cb-a409-998381ab1681 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:42.987452 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3cb09c-8e47-44cb-a409-998381ab1681 service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:42.997719 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 506/1006] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:46.013014 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c355c1-6103-43c3-9867-f9b0f6ae45e9 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:46.013710 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c355c1-6103-43c3-9867-f9b0f6ae45e9 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:46.013710 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c355c1-6103-43c3-9867-f9b0f6ae45e9 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:46.015383 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 501/1007] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:46.022571 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798c419-2d68-4c24-bb8c-830bc3c8f38d None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:46.023140 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798c419-2d68-4c24-bb8c-830bc3c8f38d None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:46.023140 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798c419-2d68-4c24-bb8c-830bc3c8f38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:46.043621 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-d798c419-2d68-4c24-bb8c-830bc3c8f38d None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:46.044850 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-d798c419-2d68-4c24-bb8c-830bc3c8f38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:46.054369 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 507/1008] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:46.518804 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c355c1-6103-43c3-9867-f9b0f6ae45e9 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:46.526381 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=37 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:09:46.534197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c355c1-6103-43c3-9867-f9b0f6ae45e9 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:46.548201 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456b3ef-49f2-46c0-ad79-70a2db104813 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:46.548819 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456b3ef-49f2-46c0-ad79-70a2db104813 service nova] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:46.549098 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456b3ef-49f2-46c0-ad79-70a2db104813 service nova] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:46.549371 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456b3ef-49f2-46c0-ad79-70a2db104813 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:46.558557 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456b3ef-49f2-46c0-ad79-70a2db104813 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:46.560258 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456b3ef-49f2-46c0-ad79-70a2db104813 service nova] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:46.574025 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 502/1009] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:49.840956 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc2274-dabc-43c7-a23b-122b5e8dd1f1 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:49.841545 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc2274-dabc-43c7-a23b-122b5e8dd1f1 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:49.841545 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc2274-dabc-43c7-a23b-122b5e8dd1f1 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:49.842835 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 508/1010] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:49.848479 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f40f8e-b379-4033-b31c-347a8530f05d None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:49.848992 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f40f8e-b379-4033-b31c-347a8530f05d None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:49.849093 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f40f8e-b379-4033-b31c-347a8530f05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:49.869130 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-13f40f8e-b379-4033-b31c-347a8530f05d None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:49.870324 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-13f40f8e-b379-4033-b31c-347a8530f05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:49.879035 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 503/1011] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:50.228137 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc2274-dabc-43c7-a23b-122b5e8dd1f1 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:50.242207 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc2274-dabc-43c7-a23b-122b5e8dd1f1 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:50.247141 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c12b3-ef98-4f7b-8152-db036c9fba9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:50.247752 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c12b3-ef98-4f7b-8152-db036c9fba9c service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:50.248041 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c12b3-ef98-4f7b-8152-db036c9fba9c service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:50.248306 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c12b3-ef98-4f7b-8152-db036c9fba9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:50.257558 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c12b3-ef98-4f7b-8152-db036c9fba9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:50.259186 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c12b3-ef98-4f7b-8152-db036c9fba9c service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:50.269017 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 509/1012] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:09:51.450922 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445a769-8a9e-434d-9e9d-e9b5953b3e71 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:51.451524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445a769-8a9e-434d-9e9d-e9b5953b3e71 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:51.451524 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445a769-8a9e-434d-9e9d-e9b5953b3e71 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:51.452803 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 504/1013] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:09:51.458914 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fe0b3-07fc-41af-8517-974a94f0ae22 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:51.459435 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fe0b3-07fc-41af-8517-974a94f0ae22 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:51.459435 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fe0b3-07fc-41af-8517-974a94f0ae22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:51.478591 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-3b0fe0b3-07fc-41af-8517-974a94f0ae22 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:51.480080 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-3b0fe0b3-07fc-41af-8517-974a94f0ae22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:51.488462 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 510/1014] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:51.847799 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac8c17-ee3a-4f42-90f5-66b6f2820b28 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:51.848086 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac8c17-ee3a-4f42-90f5-66b6f2820b28 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:51.848364 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac8c17-ee3a-4f42-90f5-66b6f2820b28 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:51.849677 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 505/1015] 10.222.0.15 () {54 vars in 966 bytes} [Tue Sep 13 12:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:51.855049 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37baa30-db71-4825-9655-683be82bf3f5 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:51.855429 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37baa30-db71-4825-9655-683be82bf3f5 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:51.855774 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37baa30-db71-4825-9655-683be82bf3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:51.894230 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-a37baa30-db71-4825-9655-683be82bf3f5 None None] MFA Rules not processed for user `4e2b26fb30024905986a99000564b475`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:51.895471 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-a37baa30-db71-4825-9655-683be82bf3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:51.956758 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 511/1016] 10.222.0.15 () {58 vars in 1063 bytes} [Tue Sep 13 12:09:51 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:09:51.964768 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac8c17-ee3a-4f42-90f5-66b6f2820b28 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:51.975824 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac8c17-ee3a-4f42-90f5-66b6f2820b28 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:51.979406 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67da532-ec39-4b3e-8534-22e2a3837f58 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e2b26fb30024905986a99000564b475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:51.979994 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67da532-ec39-4b3e-8534-22e2a3837f58 service glance] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:51.980275 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67da532-ec39-4b3e-8534-22e2a3837f58 service glance] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:51.980553 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67da532-ec39-4b3e-8534-22e2a3837f58 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:51.990265 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67da532-ec39-4b3e-8534-22e2a3837f58 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:51.991721 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67da532-ec39-4b3e-8534-22e2a3837f58 service glance] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:52.001673 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 506/1017] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:52.758488 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0ca9c-5019-4c31-974a-f5885d52f40f None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:52.768165 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0ca9c-5019-4c31-974a-f5885d52f40f None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:52.768165 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0ca9c-5019-4c31-974a-f5885d52f40f None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:52.768165 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 512/1018] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:52.768427 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dd677-3158-46a1-ad3e-fc42ebe443dc None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:52.768427 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dd677-3158-46a1-ad3e-fc42ebe443dc None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:52.768427 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dd677-3158-46a1-ad3e-fc42ebe443dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:52.795333 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-1a4dd677-3158-46a1-ad3e-fc42ebe443dc None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:52.796783 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-1a4dd677-3158-46a1-ad3e-fc42ebe443dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:52.807230 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 507/1019] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:09:53.156154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0ca9c-5019-4c31-974a-f5885d52f40f None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:53.169693 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0ca9c-5019-4c31-974a-f5885d52f40f None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:53.178077 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2def239-e694-47de-a43e-bf453983cb71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:53.178719 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2def239-e694-47de-a43e-bf453983cb71 service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:53.179023 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2def239-e694-47de-a43e-bf453983cb71 service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:53.179293 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2def239-e694-47de-a43e-bf453983cb71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:53.190785 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2def239-e694-47de-a43e-bf453983cb71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:53.192408 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2def239-e694-47de-a43e-bf453983cb71 service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:53.202550 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 513/1020] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:55.780445 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbea32-803c-43cd-ab33-acc8df23a71c None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:55.781646 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbea32-803c-43cd-ab33-acc8df23a71c None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:55.781646 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbea32-803c-43cd-ab33-acc8df23a71c None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:55.783180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 508/1021] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:09:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:55.788786 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcad825-a614-448f-b5a0-6cc1f0658062 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:55.789262 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcad825-a614-448f-b5a0-6cc1f0658062 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:55.789366 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcad825-a614-448f-b5a0-6cc1f0658062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:55.811627 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-dfcad825-a614-448f-b5a0-6cc1f0658062 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:55.813493 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-dfcad825-a614-448f-b5a0-6cc1f0658062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:55.821664 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 514/1022] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:56.181480 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbea32-803c-43cd-ab33-acc8df23a71c None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:56.195547 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbea32-803c-43cd-ab33-acc8df23a71c None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:56.200676 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fe965-f94d-4f9a-a462-a6c84db67b51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:56.201356 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fe965-f94d-4f9a-a462-a6c84db67b51 service nova] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:56.201704 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fe965-f94d-4f9a-a462-a6c84db67b51 service nova] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:56.202047 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fe965-f94d-4f9a-a462-a6c84db67b51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:56.211732 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fe965-f94d-4f9a-a462-a6c84db67b51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:56.213358 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fe965-f94d-4f9a-a462-a6c84db67b51 service nova] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:56.223966 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 509/1023] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:09:58.900271 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439c804-1a9d-4ab7-80c8-3c5ec6205991 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:58.900271 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439c804-1a9d-4ab7-80c8-3c5ec6205991 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:58.900271 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439c804-1a9d-4ab7-80c8-3c5ec6205991 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:58.900271 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 515/1024] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:09:58.906409 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45a231-86f9-4860-b193-917936a31823 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:58.906890 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45a231-86f9-4860-b193-917936a31823 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:58.907104 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45a231-86f9-4860-b193-917936a31823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:58.928315 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-bb45a231-86f9-4860-b193-917936a31823 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:09:58.929998 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-bb45a231-86f9-4860-b193-917936a31823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:09:58.940439 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 510/1025] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:09:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:09:59.296250 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439c804-1a9d-4ab7-80c8-3c5ec6205991 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:09:59.310960 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439c804-1a9d-4ab7-80c8-3c5ec6205991 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:09:59.316306 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6859fa-b6ce-4f4e-b74d-5e8dce55d5c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:09:59.317033 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6859fa-b6ce-4f4e-b74d-5e8dce55d5c8 service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:09:59.317395 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6859fa-b6ce-4f4e-b74d-5e8dce55d5c8 service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:09:59.317728 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6859fa-b6ce-4f4e-b74d-5e8dce55d5c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:09:59.327115 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6859fa-b6ce-4f4e-b74d-5e8dce55d5c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:09:59.329496 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6859fa-b6ce-4f4e-b74d-5e8dce55d5c8 service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:09:59.340535 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 516/1026] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:09:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:07.962152 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2516f-302d-454b-8173-f14610283758 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:07.962769 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2516f-302d-454b-8173-f14610283758 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:07.962769 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2516f-302d-454b-8173-f14610283758 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:07.964004 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 511/1027] 10.222.0.15 () {54 vars in 918 bytes} [Tue Sep 13 12:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:07.969775 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d735b-921c-49cd-a66b-29abfb106499 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:07.970319 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d735b-921c-49cd-a66b-29abfb106499 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:07.970319 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d735b-921c-49cd-a66b-29abfb106499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:07.977896 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=71 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:07.991596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-a09d735b-921c-49cd-a66b-29abfb106499 None None] MFA Rules not processed for user `e72796c5d7864bd8887419c60e3bbc1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:07.992831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-a09d735b-921c-49cd-a66b-29abfb106499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:08.001669 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 517/1028] 10.222.0.15 () {58 vars in 1015 bytes} [Tue Sep 13 12:10:07 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:10:08.016394 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1665dba-c209-4bd4-adc8-34b1e3429312 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:08.016686 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1665dba-c209-4bd4-adc8-34b1e3429312 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:08.016960 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1665dba-c209-4bd4-adc8-34b1e3429312 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:08.018309 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 512/1029] 10.222.0.15 () {54 vars in 918 bytes} [Tue Sep 13 12:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:08.023284 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6608c-c614-423c-b4aa-8e1adf0e802f None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:08.023568 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6608c-c614-423c-b4aa-8e1adf0e802f None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:08.023842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6608c-c614-423c-b4aa-8e1adf0e802f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:08.045004 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-6fa6608c-c614-423c-b4aa-8e1adf0e802f None None] MFA Rules not processed for user `e740dc7330284b0bbe6a825186f0a55d`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:08.046783 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-6fa6608c-c614-423c-b4aa-8e1adf0e802f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:08.055391 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 518/1030] 10.222.0.15 () {58 vars in 1015 bytes} [Tue Sep 13 12:10:08 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:08.922940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=26 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:10.949790 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fbb51-7c20-4ee7-9e20-aa2044901bfd None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:10.950401 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fbb51-7c20-4ee7-9e20-aa2044901bfd None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:10.950401 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fbb51-7c20-4ee7-9e20-aa2044901bfd None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:10.951586 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 513/1031] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:10.957385 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f5086-6f38-447d-99a0-cb1d80c5b989 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:10.957905 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f5086-6f38-447d-99a0-cb1d80c5b989 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:10.957905 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f5086-6f38-447d-99a0-cb1d80c5b989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:10.977979 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-751f5086-6f38-447d-99a0-cb1d80c5b989 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:10.979215 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-751f5086-6f38-447d-99a0-cb1d80c5b989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:10.987905 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 519/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:10:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:11.331618 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fbb51-7c20-4ee7-9e20-aa2044901bfd None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:11.345768 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fbb51-7c20-4ee7-9e20-aa2044901bfd None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:11.351023 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7acf150-387f-4f95-b17d-e497be2a1f50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:11.351620 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acf150-387f-4f95-b17d-e497be2a1f50 service nova] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:11.351893 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acf150-387f-4f95-b17d-e497be2a1f50 service nova] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:11.352163 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acf150-387f-4f95-b17d-e497be2a1f50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:11.361207 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acf150-387f-4f95-b17d-e497be2a1f50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:11.362855 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acf150-387f-4f95-b17d-e497be2a1f50 service nova] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:11.372663 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 514/1033] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:13.128793 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c5c8b-a62c-481f-9c2d-bdd8933489be None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:13.129340 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c5c8b-a62c-481f-9c2d-bdd8933489be None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:13.129340 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c5c8b-a62c-481f-9c2d-bdd8933489be None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:13.130682 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 520/1034] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:13.135827 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c91dc5-4d47-4149-ab5f-3e8a055feb69 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:13.136316 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c91dc5-4d47-4149-ab5f-3e8a055feb69 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:13.136424 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c91dc5-4d47-4149-ab5f-3e8a055feb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:13.157279 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-30c91dc5-4d47-4149-ab5f-3e8a055feb69 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:13.158471 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-30c91dc5-4d47-4149-ab5f-3e8a055feb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:13.166801 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 515/1035] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:10:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:13.420453 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c5c8b-a62c-481f-9c2d-bdd8933489be None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:13.434739 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c5c8b-a62c-481f-9c2d-bdd8933489be None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:13.439786 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b12d4-dfe6-40ea-aa1f-510a2cc85453 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:13.440393 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b12d4-dfe6-40ea-aa1f-510a2cc85453 service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:13.440676 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b12d4-dfe6-40ea-aa1f-510a2cc85453 service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:13.440950 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b12d4-dfe6-40ea-aa1f-510a2cc85453 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:13.449601 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b12d4-dfe6-40ea-aa1f-510a2cc85453 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:13.451226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b12d4-dfe6-40ea-aa1f-510a2cc85453 service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:13.462223 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 521/1036] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:15.212984 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae53ff5-cb13-4804-b3ee-f7c00cee1d45 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:15.213610 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae53ff5-cb13-4804-b3ee-f7c00cee1d45 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:15.213610 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae53ff5-cb13-4804-b3ee-f7c00cee1d45 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:15.214920 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 516/1037] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:15.220113 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c8025-0adc-4cac-9642-cde6d51d2a8e None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:15.220628 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c8025-0adc-4cac-9642-cde6d51d2a8e None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:15.220731 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c8025-0adc-4cac-9642-cde6d51d2a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:15.247426 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-278c8025-0adc-4cac-9642-cde6d51d2a8e None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:15.248643 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-278c8025-0adc-4cac-9642-cde6d51d2a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:15.257662 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 522/1038] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:10:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:15.423979 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae53ff5-cb13-4804-b3ee-f7c00cee1d45 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:15.441023 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae53ff5-cb13-4804-b3ee-f7c00cee1d45 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:15.445880 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099736cd-dfcd-45c6-b1d8-c5b3dbdccdf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:15.446469 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099736cd-dfcd-45c6-b1d8-c5b3dbdccdf4 service nova] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:15.446778 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099736cd-dfcd-45c6-b1d8-c5b3dbdccdf4 service nova] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:15.447051 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099736cd-dfcd-45c6-b1d8-c5b3dbdccdf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:15.455745 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099736cd-dfcd-45c6-b1d8-c5b3dbdccdf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:15.457326 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099736cd-dfcd-45c6-b1d8-c5b3dbdccdf4 service nova] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:15.467655 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 517/1039] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:17.189620 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cb0e2-7ae7-45f8-9893-2ce5553eb034 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:17.191339 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cb0e2-7ae7-45f8-9893-2ce5553eb034 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:17.191339 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cb0e2-7ae7-45f8-9893-2ce5553eb034 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:17.191693 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 523/1040] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:17.198688 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e142a9-188c-44a1-a3bb-ade0ceccfbf5 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:17.199202 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e142a9-188c-44a1-a3bb-ade0ceccfbf5 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:17.199311 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e142a9-188c-44a1-a3bb-ade0ceccfbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:17.219730 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-87e142a9-188c-44a1-a3bb-ade0ceccfbf5 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:17.220955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-87e142a9-188c-44a1-a3bb-ade0ceccfbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:17.229005 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 518/1041] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:10:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:17.390214 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cb0e2-7ae7-45f8-9893-2ce5553eb034 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:17.404307 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cb0e2-7ae7-45f8-9893-2ce5553eb034 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:17.409419 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c98c3-eb16-4908-89c2-c63118e7f3bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:17.410022 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c98c3-eb16-4908-89c2-c63118e7f3bd service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:17.410563 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c98c3-eb16-4908-89c2-c63118e7f3bd service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:17.410871 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c98c3-eb16-4908-89c2-c63118e7f3bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:17.419688 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c98c3-eb16-4908-89c2-c63118e7f3bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:17.421822 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c98c3-eb16-4908-89c2-c63118e7f3bd service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:17.432227 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 524/1042] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:19.185679 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc6837-8e68-4e72-817b-317bf8189a89 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:19.186225 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc6837-8e68-4e72-817b-317bf8189a89 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:19.186225 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc6837-8e68-4e72-817b-317bf8189a89 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:19.188562 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 519/1043] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:10:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:19.193829 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890efd5d-bd06-4ec0-99ce-836259ecd7a0 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:19.194305 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890efd5d-bd06-4ec0-99ce-836259ecd7a0 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:19.194423 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890efd5d-bd06-4ec0-99ce-836259ecd7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:19.214442 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-890efd5d-bd06-4ec0-99ce-836259ecd7a0 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:19.215701 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-890efd5d-bd06-4ec0-99ce-836259ecd7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:19.224149 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 525/1044] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:10:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:19.386636 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc6837-8e68-4e72-817b-317bf8189a89 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:19.403392 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc6837-8e68-4e72-817b-317bf8189a89 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:19.409017 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f464de-c929-4041-a95f-3044f6d2ad9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:19.409613 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f464de-c929-4041-a95f-3044f6d2ad9a service nova] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:19.409889 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f464de-c929-4041-a95f-3044f6d2ad9a service nova] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:19.410160 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f464de-c929-4041-a95f-3044f6d2ad9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:19.419045 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f464de-c929-4041-a95f-3044f6d2ad9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:19.420629 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f464de-c929-4041-a95f-3044f6d2ad9a service nova] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:19.432317 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 520/1045] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:21.091318 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b171b12-d8d3-4ac7-9cb6-b1538a02f778 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:21.091961 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b171b12-d8d3-4ac7-9cb6-b1538a02f778 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:21.091961 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b171b12-d8d3-4ac7-9cb6-b1538a02f778 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:21.093207 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 526/1046] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:21.098369 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5736d8-ed15-43fd-9e97-95f85b5d07b3 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:21.098862 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5736d8-ed15-43fd-9e97-95f85b5d07b3 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:21.098979 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5736d8-ed15-43fd-9e97-95f85b5d07b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:21.120741 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-1a5736d8-ed15-43fd-9e97-95f85b5d07b3 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:21.121951 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-1a5736d8-ed15-43fd-9e97-95f85b5d07b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:21.132503 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 521/1047] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:10:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:21.293453 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b171b12-d8d3-4ac7-9cb6-b1538a02f778 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:21.307641 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b171b12-d8d3-4ac7-9cb6-b1538a02f778 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:21.312694 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db44c3-a6be-406d-a2d5-4ad6a86ddce2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:21.313294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db44c3-a6be-406d-a2d5-4ad6a86ddce2 service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:21.313571 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db44c3-a6be-406d-a2d5-4ad6a86ddce2 service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:21.313843 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db44c3-a6be-406d-a2d5-4ad6a86ddce2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:21.322309 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db44c3-a6be-406d-a2d5-4ad6a86ddce2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:21.324557 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db44c3-a6be-406d-a2d5-4ad6a86ddce2 service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:21.333915 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 527/1048] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:23.022570 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b7885-6812-4d33-87d7-cf15dcc06170 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:23.023130 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b7885-6812-4d33-87d7-cf15dcc06170 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:23.023130 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b7885-6812-4d33-87d7-cf15dcc06170 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:23.024404 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 522/1049] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:23.029376 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf5d3a-f58d-4f33-b776-b26bdc820f28 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:23.029790 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf5d3a-f58d-4f33-b776-b26bdc820f28 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:23.030500 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf5d3a-f58d-4f33-b776-b26bdc820f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:23.052718 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-fdaf5d3a-f58d-4f33-b776-b26bdc820f28 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:23.053931 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-fdaf5d3a-f58d-4f33-b776-b26bdc820f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:23.061875 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 528/1050] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:10:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:23.222782 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b7885-6812-4d33-87d7-cf15dcc06170 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:23.236189 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b7885-6812-4d33-87d7-cf15dcc06170 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:23.241128 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f32a5-b489-447c-9ee3-cc5ff258f9ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:23.241730 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f32a5-b489-447c-9ee3-cc5ff258f9ef service nova] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:23.242008 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f32a5-b489-447c-9ee3-cc5ff258f9ef service nova] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:23.242299 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f32a5-b489-447c-9ee3-cc5ff258f9ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:23.251522 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f32a5-b489-447c-9ee3-cc5ff258f9ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:23.253220 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f32a5-b489-447c-9ee3-cc5ff258f9ef service nova] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:23.262999 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 523/1051] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:24.937975 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c04e0-c7a2-499f-917d-8dbf5ba30f79 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:24.938513 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c04e0-c7a2-499f-917d-8dbf5ba30f79 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:24.938513 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c04e0-c7a2-499f-917d-8dbf5ba30f79 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:24.939881 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 529/1052] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:24.945158 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42188ea8-860b-4a6f-95d6-4638bfb8c59f None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:24.945665 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42188ea8-860b-4a6f-95d6-4638bfb8c59f None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:24.945759 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42188ea8-860b-4a6f-95d6-4638bfb8c59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:24.965760 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-42188ea8-860b-4a6f-95d6-4638bfb8c59f None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:24.967013 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-42188ea8-860b-4a6f-95d6-4638bfb8c59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:24.975633 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 524/1053] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:10:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:25.137861 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c04e0-c7a2-499f-917d-8dbf5ba30f79 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:25.151989 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c04e0-c7a2-499f-917d-8dbf5ba30f79 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:25.156931 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba6499-3a1f-4fbb-abd0-e227c54fa790 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:25.157526 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba6499-3a1f-4fbb-abd0-e227c54fa790 service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:25.157803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba6499-3a1f-4fbb-abd0-e227c54fa790 service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:25.158075 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba6499-3a1f-4fbb-abd0-e227c54fa790 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:25.166842 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba6499-3a1f-4fbb-abd0-e227c54fa790 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:25.168432 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba6499-3a1f-4fbb-abd0-e227c54fa790 service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:25.178207 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 530/1054] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:26.840805 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade74279-d6c7-405e-a16e-ee08da88c7f9 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:26.841365 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade74279-d6c7-405e-a16e-ee08da88c7f9 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:26.841365 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade74279-d6c7-405e-a16e-ee08da88c7f9 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:26.842826 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 525/1055] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:26.848341 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872618d8-c918-48ea-be71-4579b464806b None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:26.848838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872618d8-c918-48ea-be71-4579b464806b None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:26.848838 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872618d8-c918-48ea-be71-4579b464806b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:26.868472 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-872618d8-c918-48ea-be71-4579b464806b None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:26.869688 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-872618d8-c918-48ea-be71-4579b464806b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:26.878289 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 531/1056] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:10:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:27.040482 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade74279-d6c7-405e-a16e-ee08da88c7f9 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:27.055335 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade74279-d6c7-405e-a16e-ee08da88c7f9 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:27.060327 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cfdc9-651a-4fd3-9fec-2b33a9422d2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:27.060917 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cfdc9-651a-4fd3-9fec-2b33a9422d2b service nova] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:27.061235 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cfdc9-651a-4fd3-9fec-2b33a9422d2b service nova] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:27.062160 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cfdc9-651a-4fd3-9fec-2b33a9422d2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:27.070887 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cfdc9-651a-4fd3-9fec-2b33a9422d2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:27.072460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cfdc9-651a-4fd3-9fec-2b33a9422d2b service nova] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:27.082896 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 526/1057] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:29.465184 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d61d1-b373-4730-a539-377094b52429 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:29.465746 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d61d1-b373-4730-a539-377094b52429 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:29.465746 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d61d1-b373-4730-a539-377094b52429 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:29.467173 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 532/1058] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:29.473016 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27761ceb-633f-49c0-9f97-97808abaf04e None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:29.473528 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27761ceb-633f-49c0-9f97-97808abaf04e None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:29.473528 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27761ceb-633f-49c0-9f97-97808abaf04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:29.494341 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-27761ceb-633f-49c0-9f97-97808abaf04e None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:29.495622 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-27761ceb-633f-49c0-9f97-97808abaf04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:29.504753 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 527/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:10:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:29.848539 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d61d1-b373-4730-a539-377094b52429 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:29.859809 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d61d1-b373-4730-a539-377094b52429 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:29.863254 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14368773-8bfa-44f3-b8bb-ce7510b4a565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:29.863876 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14368773-8bfa-44f3-b8bb-ce7510b4a565 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:29.864154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14368773-8bfa-44f3-b8bb-ce7510b4a565 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:29.864425 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14368773-8bfa-44f3-b8bb-ce7510b4a565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:29.874175 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14368773-8bfa-44f3-b8bb-ce7510b4a565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:29.875755 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14368773-8bfa-44f3-b8bb-ce7510b4a565 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:29.885451 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 533/1060] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:32.508925 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec48a8d-2d52-4ac5-aa7b-6c1d676faee4 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:32.509489 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec48a8d-2d52-4ac5-aa7b-6c1d676faee4 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:32.509489 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec48a8d-2d52-4ac5-aa7b-6c1d676faee4 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:32.510851 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 528/1061] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:32.516908 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282b100-c3b9-4372-8b8c-8939f6c6f86a None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:32.517510 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282b100-c3b9-4372-8b8c-8939f6c6f86a None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:32.517510 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282b100-c3b9-4372-8b8c-8939f6c6f86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:32.538755 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-a282b100-c3b9-4372-8b8c-8939f6c6f86a None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:32.540010 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-a282b100-c3b9-4372-8b8c-8939f6c6f86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:32.547969 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 534/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:10:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:10:32.888557 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec48a8d-2d52-4ac5-aa7b-6c1d676faee4 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:32.899936 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec48a8d-2d52-4ac5-aa7b-6c1d676faee4 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:32.903566 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceffe17-18f4-4a89-a546-15b675b6d6d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:32.904175 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceffe17-18f4-4a89-a546-15b675b6d6d8 service neutron] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:32.904452 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceffe17-18f4-4a89-a546-15b675b6d6d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:32.904741 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceffe17-18f4-4a89-a546-15b675b6d6d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:32.914916 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceffe17-18f4-4a89-a546-15b675b6d6d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:32.916382 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceffe17-18f4-4a89-a546-15b675b6d6d8 service neutron] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:32.926516 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 529/1063] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:35.746151 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82defba4-efdd-4ae1-945b-dbcb938ff91e None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:35.746703 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82defba4-efdd-4ae1-945b-dbcb938ff91e None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:35.746823 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82defba4-efdd-4ae1-945b-dbcb938ff91e None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:35.748076 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 535/1064] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:35.754539 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a99c9-8ce8-4158-b3f2-09f82bccfce5 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:35.755035 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a99c9-8ce8-4158-b3f2-09f82bccfce5 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:35.755152 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a99c9-8ce8-4158-b3f2-09f82bccfce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:35.775431 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-db8a99c9-8ce8-4158-b3f2-09f82bccfce5 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:35.776639 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-db8a99c9-8ce8-4158-b3f2-09f82bccfce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:35.784722 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 530/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:10:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:36.126184 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82defba4-efdd-4ae1-945b-dbcb938ff91e None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:36.137221 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82defba4-efdd-4ae1-945b-dbcb938ff91e None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:36.141615 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac5457-e3b3-42ed-8d27-54eba0c521ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:36.142241 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac5457-e3b3-42ed-8d27-54eba0c521ff service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:36.142515 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac5457-e3b3-42ed-8d27-54eba0c521ff service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:36.142819 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac5457-e3b3-42ed-8d27-54eba0c521ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:36.152925 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac5457-e3b3-42ed-8d27-54eba0c521ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:36.154398 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac5457-e3b3-42ed-8d27-54eba0c521ff service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:36.164900 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 536/1066] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:38.809419 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e89e65-f8d1-46cf-ac43-59a68c7a53e7 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:38.809954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e89e65-f8d1-46cf-ac43-59a68c7a53e7 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:38.809954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e89e65-f8d1-46cf-ac43-59a68c7a53e7 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:38.811376 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 531/1067] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:38.817222 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f19f79-8707-4dc4-93ea-a7070fbc6f38 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:38.817657 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f19f79-8707-4dc4-93ea-a7070fbc6f38 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:38.817857 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f19f79-8707-4dc4-93ea-a7070fbc6f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:38.827400 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=60 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:38.840134 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-d5f19f79-8707-4dc4-93ea-a7070fbc6f38 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:38.841333 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-d5f19f79-8707-4dc4-93ea-a7070fbc6f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:38.849565 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 537/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:10:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:39.187707 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e89e65-f8d1-46cf-ac43-59a68c7a53e7 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:39.193218 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=55 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:10:39.200121 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e89e65-f8d1-46cf-ac43-59a68c7a53e7 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:39.204485 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0283b-ca36-4214-a87c-0fea3be15a70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:39.205113 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0283b-ca36-4214-a87c-0fea3be15a70 service neutron] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:39.205392 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0283b-ca36-4214-a87c-0fea3be15a70 service neutron] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:39.205661 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0283b-ca36-4214-a87c-0fea3be15a70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:39.215007 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0283b-ca36-4214-a87c-0fea3be15a70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:39.216432 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0283b-ca36-4214-a87c-0fea3be15a70 service neutron] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:39.226859 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 532/1069] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:41.747739 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660b6a2-f700-4425-a65c-a802ac6f2f1d None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:41.748803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660b6a2-f700-4425-a65c-a802ac6f2f1d None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:41.748803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660b6a2-f700-4425-a65c-a802ac6f2f1d None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:41.750125 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 538/1070] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:41.755799 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac23eaa-f111-4477-bf1e-144d145d6010 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:41.756298 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac23eaa-f111-4477-bf1e-144d145d6010 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:41.756395 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac23eaa-f111-4477-bf1e-144d145d6010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:41.776626 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-1ac23eaa-f111-4477-bf1e-144d145d6010 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:41.777837 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-1ac23eaa-f111-4477-bf1e-144d145d6010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:41.785901 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 533/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:10:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:42.118735 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660b6a2-f700-4425-a65c-a802ac6f2f1d None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:42.130211 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660b6a2-f700-4425-a65c-a802ac6f2f1d None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:42.133768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b770172-262d-4ab5-bea9-ee7499e506c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:42.134365 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b770172-262d-4ab5-bea9-ee7499e506c9 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:42.134670 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b770172-262d-4ab5-bea9-ee7499e506c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:42.134947 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b770172-262d-4ab5-bea9-ee7499e506c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:42.145009 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b770172-262d-4ab5-bea9-ee7499e506c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:42.146436 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b770172-262d-4ab5-bea9-ee7499e506c9 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:42.157041 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 539/1072] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:44.711022 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48f105-156c-4f5b-9007-8d152d15e2ef None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:44.711566 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48f105-156c-4f5b-9007-8d152d15e2ef None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:44.711566 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e48f105-156c-4f5b-9007-8d152d15e2ef None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:44.712907 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 534/1073] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:44.719362 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf95730-9483-49ec-800a-84e3583e3a78 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:44.720067 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf95730-9483-49ec-800a-84e3583e3a78 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:44.720067 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf95730-9483-49ec-800a-84e3583e3a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:44.740002 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-4cf95730-9483-49ec-800a-84e3583e3a78 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:44.741228 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-4cf95730-9483-49ec-800a-84e3583e3a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:44.750479 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 540/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:10:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:45.091715 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48f105-156c-4f5b-9007-8d152d15e2ef None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:45.105760 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e48f105-156c-4f5b-9007-8d152d15e2ef None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:45.109508 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b77b98-5ae0-4926-bb4b-d8918c967abe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:45.110081 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b77b98-5ae0-4926-bb4b-d8918c967abe service neutron] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:45.110361 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b77b98-5ae0-4926-bb4b-d8918c967abe service neutron] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:45.110654 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b77b98-5ae0-4926-bb4b-d8918c967abe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:45.120357 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b77b98-5ae0-4926-bb4b-d8918c967abe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:45.121832 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b77b98-5ae0-4926-bb4b-d8918c967abe service neutron] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:45.131938 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 535/1075] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:47.636987 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab6c01-3df3-4154-95ae-683b4bc61ef1 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:47.637555 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab6c01-3df3-4154-95ae-683b4bc61ef1 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:47.637555 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab6c01-3df3-4154-95ae-683b4bc61ef1 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:47.639535 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 541/1076] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:10:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:47.645389 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bf148-da20-4a5e-bf81-67e4b584bca0 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:47.645869 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bf148-da20-4a5e-bf81-67e4b584bca0 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:47.645982 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bf148-da20-4a5e-bf81-67e4b584bca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:47.665628 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-5a0bf148-da20-4a5e-bf81-67e4b584bca0 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:47.667024 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-5a0bf148-da20-4a5e-bf81-67e4b584bca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:47.675407 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 536/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:10:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:48.012504 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab6c01-3df3-4154-95ae-683b4bc61ef1 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:48.023181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab6c01-3df3-4154-95ae-683b4bc61ef1 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:48.026576 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb26b94-51c9-4563-8047-357cbb0f5b06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:48.027192 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb26b94-51c9-4563-8047-357cbb0f5b06 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:48.027467 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb26b94-51c9-4563-8047-357cbb0f5b06 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:48.027734 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb26b94-51c9-4563-8047-357cbb0f5b06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:48.037513 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb26b94-51c9-4563-8047-357cbb0f5b06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:48.038968 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb26b94-51c9-4563-8047-357cbb0f5b06 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:48.049481 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 542/1078] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:50.595299 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7954a-4777-4382-a7dd-b4f915cb45ac None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:50.595880 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7954a-4777-4382-a7dd-b4f915cb45ac None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:50.595880 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad7954a-4777-4382-a7dd-b4f915cb45ac None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:50.597177 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 537/1079] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:10:50.602830 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6086b-4cb5-49d7-8010-ec86734a8320 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:50.603277 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6086b-4cb5-49d7-8010-ec86734a8320 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:50.603417 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6086b-4cb5-49d7-8010-ec86734a8320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:50.623498 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-42f6086b-4cb5-49d7-8010-ec86734a8320 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:50.625026 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-42f6086b-4cb5-49d7-8010-ec86734a8320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:50.633238 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 543/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:10:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:50.978815 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7954a-4777-4382-a7dd-b4f915cb45ac None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:50.990432 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad7954a-4777-4382-a7dd-b4f915cb45ac None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:50.994013 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fe74b-6fe8-44ac-8b16-a38f887dab1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:50.994603 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fe74b-6fe8-44ac-8b16-a38f887dab1f service neutron] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:50.994914 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fe74b-6fe8-44ac-8b16-a38f887dab1f service neutron] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:50.995187 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fe74b-6fe8-44ac-8b16-a38f887dab1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:51.004937 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156fe74b-6fe8-44ac-8b16-a38f887dab1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:51.006366 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156fe74b-6fe8-44ac-8b16-a38f887dab1f service neutron] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:51.016009 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 538/1081] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:53.453274 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b11bf-98ee-4450-a35c-2cbef5bdbe3a None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:53.453845 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b11bf-98ee-4450-a35c-2cbef5bdbe3a None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:53.453845 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b11bf-98ee-4450-a35c-2cbef5bdbe3a None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:53.455198 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 544/1082] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:10:53.460429 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da4a5d-6e29-47fa-9de2-764837d9fe93 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:53.460831 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da4a5d-6e29-47fa-9de2-764837d9fe93 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:53.460987 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da4a5d-6e29-47fa-9de2-764837d9fe93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:53.480676 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-b5da4a5d-6e29-47fa-9de2-764837d9fe93 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:53.481873 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-b5da4a5d-6e29-47fa-9de2-764837d9fe93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:53.496021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 539/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:10:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:53.833633 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b11bf-98ee-4450-a35c-2cbef5bdbe3a None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:53.844553 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b11bf-98ee-4450-a35c-2cbef5bdbe3a None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:53.848021 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef811ab-9bee-4275-ab78-c1327cd8c0ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:53.848607 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef811ab-9bee-4275-ab78-c1327cd8c0ab service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:53.848883 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef811ab-9bee-4275-ab78-c1327cd8c0ab service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:53.849151 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef811ab-9bee-4275-ab78-c1327cd8c0ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:53.858108 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef811ab-9bee-4275-ab78-c1327cd8c0ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:53.859561 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef811ab-9bee-4275-ab78-c1327cd8c0ab service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:53.868712 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 545/1084] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:10:56.287950 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5fabc-8da6-476a-8ead-1a805ef172c6 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:56.288523 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5fabc-8da6-476a-8ead-1a805ef172c6 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:56.288523 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5fabc-8da6-476a-8ead-1a805ef172c6 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:56.289838 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 540/1085] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:10:56.295915 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe428fb-ac89-4dae-bee5-f8269aa2c787 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:56.296476 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe428fb-ac89-4dae-bee5-f8269aa2c787 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:56.296476 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe428fb-ac89-4dae-bee5-f8269aa2c787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:56.317644 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-1fe428fb-ac89-4dae-bee5-f8269aa2c787 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:10:56.318906 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-1fe428fb-ac89-4dae-bee5-f8269aa2c787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:10:56.330043 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 546/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:10:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:10:56.668763 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5fabc-8da6-476a-8ead-1a805ef172c6 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:10:56.680388 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5fabc-8da6-476a-8ead-1a805ef172c6 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:10:56.684154 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8a65f-7d9b-4256-9349-1512ae44746e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:10:56.684743 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8a65f-7d9b-4256-9349-1512ae44746e service neutron] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:10:56.685016 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8a65f-7d9b-4256-9349-1512ae44746e service neutron] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:10:56.685330 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8a65f-7d9b-4256-9349-1512ae44746e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:10:56.695022 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8a65f-7d9b-4256-9349-1512ae44746e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:10:56.696458 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8a65f-7d9b-4256-9349-1512ae44746e service neutron] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:10:56.706100 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 541/1087] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:10:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:11:06.312479 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=29 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:11:06.701872 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=32 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:11:22.305948 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b045a-f33e-4e33-985f-6b7b8697177a None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:22.306540 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b045a-f33e-4e33-985f-6b7b8697177a None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:22.306540 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b045a-f33e-4e33-985f-6b7b8697177a None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:22.307844 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 547/1088] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:11:22.313456 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f6f8c-bbb3-4419-8f42-8942dcac32d7 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:22.313903 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f6f8c-bbb3-4419-8f42-8942dcac32d7 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:22.314021 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f6f8c-bbb3-4419-8f42-8942dcac32d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:22.333559 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-1d3f6f8c-bbb3-4419-8f42-8942dcac32d7 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:11:22.334809 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-1d3f6f8c-bbb3-4419-8f42-8942dcac32d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:22.343091 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 542/1089] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:11:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:11:22.702135 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e983cb3-c4b4-463f-be31-131dc838ded7 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:22.702445 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e983cb3-c4b4-463f-be31-131dc838ded7 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:22.702748 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e983cb3-c4b4-463f-be31-131dc838ded7 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:22.704092 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 548/1090] 10.222.0.15 () {54 vars in 966 bytes} [Tue Sep 13 12:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:11:22.709725 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df24fc2-b00c-416e-9a1c-1d2920634df3 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:22.710079 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df24fc2-b00c-416e-9a1c-1d2920634df3 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:22.710298 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df24fc2-b00c-416e-9a1c-1d2920634df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:22.730947 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-8df24fc2-b00c-416e-9a1c-1d2920634df3 None None] MFA Rules not processed for user `4e2b26fb30024905986a99000564b475`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:11:22.732703 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-8df24fc2-b00c-416e-9a1c-1d2920634df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:22.739076 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 543/1091] 10.222.0.15 () {58 vars in 1063 bytes} [Tue Sep 13 12:11:22 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:11:22.746633 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e983cb3-c4b4-463f-be31-131dc838ded7 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:11:22.758203 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e983cb3-c4b4-463f-be31-131dc838ded7 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:11:22.761689 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d229cf-d856-4dd4-858a-fdc835114959 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e2b26fb30024905986a99000564b475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:11:22.762274 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d229cf-d856-4dd4-858a-fdc835114959 service glance] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:22.762552 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d229cf-d856-4dd4-858a-fdc835114959 service glance] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:22.762894 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d229cf-d856-4dd4-858a-fdc835114959 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:22.771715 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d229cf-d856-4dd4-858a-fdc835114959 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:11:22.773135 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d229cf-d856-4dd4-858a-fdc835114959 service glance] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:11:22.783484 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 549/1092] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:11:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:11:25.338806 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268b133-c71c-4b47-88c0-116f6bc92507 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:25.339422 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268b133-c71c-4b47-88c0-116f6bc92507 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:25.339422 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268b133-c71c-4b47-88c0-116f6bc92507 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:25.341215 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 544/1093] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:11:25.347213 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49714f88-2410-4b7a-b6d5-85e6e6679f47 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:25.347995 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49714f88-2410-4b7a-b6d5-85e6e6679f47 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:25.348165 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49714f88-2410-4b7a-b6d5-85e6e6679f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:25.368254 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-49714f88-2410-4b7a-b6d5-85e6e6679f47 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:11:25.369463 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-49714f88-2410-4b7a-b6d5-85e6e6679f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:25.377432 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 550/1094] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:11:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:11:25.719402 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268b133-c71c-4b47-88c0-116f6bc92507 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:11:25.733279 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268b133-c71c-4b47-88c0-116f6bc92507 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:11:25.738013 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0a36d-6749-48d6-a253-63cd9e5a6728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:11:25.738655 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0a36d-6749-48d6-a253-63cd9e5a6728 admin admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:25.738931 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0a36d-6749-48d6-a253-63cd9e5a6728 admin admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:25.739202 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0a36d-6749-48d6-a253-63cd9e5a6728 admin admin] PATH_INFO: `/v3/projects` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:25.739852 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0a36d-6749-48d6-a253-63cd9e5a6728 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:11:25.741648 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: WARNING py.warnings [None req-c3b0a36d-6749-48d6-a253-63cd9e5a6728 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:11:25.741648 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: warnings.warn(msg) Sep 13 12:11:25.741648 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: Sep 13 12:11:25.742840 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0a36d-6749-48d6-a253-63cd9e5a6728 admin admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:11:25.765124 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 545/1095] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Sep 13 12:11:25 2022] GET /identity/v3/projects => generated 1606 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:11:28.252389 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14653d75-d04f-432a-8906-6481bf85cf2e None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:28.252970 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14653d75-d04f-432a-8906-6481bf85cf2e None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:28.252970 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14653d75-d04f-432a-8906-6481bf85cf2e None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:28.254256 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 551/1096] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:11:28.259750 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105c803-6f67-4a93-82ad-5409858bf661 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:28.260193 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105c803-6f67-4a93-82ad-5409858bf661 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:28.260297 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105c803-6f67-4a93-82ad-5409858bf661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:28.280189 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-1105c803-6f67-4a93-82ad-5409858bf661 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:11:28.281623 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-1105c803-6f67-4a93-82ad-5409858bf661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:28.289818 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 546/1097] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:11:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:11:28.647205 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14653d75-d04f-432a-8906-6481bf85cf2e None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:11:28.662445 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14653d75-d04f-432a-8906-6481bf85cf2e None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:11:28.667520 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd2e21-d8f4-4040-bc43-a2100cd6aeea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:11:28.668131 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd2e21-d8f4-4040-bc43-a2100cd6aeea service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:28.668410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd2e21-d8f4-4040-bc43-a2100cd6aeea service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:28.668702 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd2e21-d8f4-4040-bc43-a2100cd6aeea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:28.678126 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd2e21-d8f4-4040-bc43-a2100cd6aeea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:11:28.679749 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd2e21-d8f4-4040-bc43-a2100cd6aeea service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:11:28.689851 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 552/1098] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:11:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:11:31.399591 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af065b-d91b-4f25-be83-498323833c78 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:31.400156 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af065b-d91b-4f25-be83-498323833c78 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:31.400156 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af065b-d91b-4f25-be83-498323833c78 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:31.401456 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 547/1099] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:11:31.406977 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cceaea1-6b46-494c-93d8-d06c0dc3465d None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:31.407445 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cceaea1-6b46-494c-93d8-d06c0dc3465d None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:31.407556 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cceaea1-6b46-494c-93d8-d06c0dc3465d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:31.427877 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-7cceaea1-6b46-494c-93d8-d06c0dc3465d None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:11:31.429105 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-7cceaea1-6b46-494c-93d8-d06c0dc3465d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:31.437913 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 553/1100] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:11:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:11:31.779007 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af065b-d91b-4f25-be83-498323833c78 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:11:31.790316 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af065b-d91b-4f25-be83-498323833c78 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:11:31.794391 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d479632-2ec4-4bd1-9cd3-5bf24d50a1ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:11:31.795017 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d479632-2ec4-4bd1-9cd3-5bf24d50a1ef service neutron] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:31.795290 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d479632-2ec4-4bd1-9cd3-5bf24d50a1ef service neutron] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:31.795558 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d479632-2ec4-4bd1-9cd3-5bf24d50a1ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:31.805015 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d479632-2ec4-4bd1-9cd3-5bf24d50a1ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:11:31.806441 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d479632-2ec4-4bd1-9cd3-5bf24d50a1ef service neutron] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:11:31.816306 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 548/1101] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:11:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:11:34.304446 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae34d1-96a5-40d2-88d7-7b171f074ca9 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:34.305023 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae34d1-96a5-40d2-88d7-7b171f074ca9 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:34.305023 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae34d1-96a5-40d2-88d7-7b171f074ca9 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:34.306364 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 554/1102] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:11:34.312744 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e9338-b9d9-4d5a-9cb7-d95fde3fbe99 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:34.313258 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e9338-b9d9-4d5a-9cb7-d95fde3fbe99 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:34.313258 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e9338-b9d9-4d5a-9cb7-d95fde3fbe99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:34.334216 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-226e9338-b9d9-4d5a-9cb7-d95fde3fbe99 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:11:34.335470 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-226e9338-b9d9-4d5a-9cb7-d95fde3fbe99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:34.343722 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 549/1103] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:11:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:11:34.683077 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae34d1-96a5-40d2-88d7-7b171f074ca9 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:11:34.693764 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae34d1-96a5-40d2-88d7-7b171f074ca9 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:11:34.697212 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c59ae8-c507-4bf9-9e00-e2ad99ae5234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:11:34.697803 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c59ae8-c507-4bf9-9e00-e2ad99ae5234 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:34.698080 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c59ae8-c507-4bf9-9e00-e2ad99ae5234 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:34.698352 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c59ae8-c507-4bf9-9e00-e2ad99ae5234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:34.707164 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c59ae8-c507-4bf9-9e00-e2ad99ae5234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:11:34.708594 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c59ae8-c507-4bf9-9e00-e2ad99ae5234 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:11:34.718996 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 555/1104] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:11:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:11:37.249066 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68823088-d0b1-47ee-bd7a-0c64df23ba89 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:37.249658 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68823088-d0b1-47ee-bd7a-0c64df23ba89 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:37.249797 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68823088-d0b1-47ee-bd7a-0c64df23ba89 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:37.251263 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 550/1105] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:11:37.257548 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3609e7d-047d-4bbe-b8b8-be95dbc3e12d None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:37.257993 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3609e7d-047d-4bbe-b8b8-be95dbc3e12d None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:37.258091 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3609e7d-047d-4bbe-b8b8-be95dbc3e12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:37.277193 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-f3609e7d-047d-4bbe-b8b8-be95dbc3e12d None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:11:37.278386 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-f3609e7d-047d-4bbe-b8b8-be95dbc3e12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:37.286997 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 556/1106] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:11:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:11:37.637167 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68823088-d0b1-47ee-bd7a-0c64df23ba89 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:11:37.647849 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68823088-d0b1-47ee-bd7a-0c64df23ba89 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:11:37.651275 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db692fb-4b2f-4403-aebd-9ee887556707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:11:37.651856 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db692fb-4b2f-4403-aebd-9ee887556707 service neutron] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:37.652134 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db692fb-4b2f-4403-aebd-9ee887556707 service neutron] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:37.652399 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db692fb-4b2f-4403-aebd-9ee887556707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:37.662162 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db692fb-4b2f-4403-aebd-9ee887556707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:11:37.663624 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db692fb-4b2f-4403-aebd-9ee887556707 service neutron] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:11:37.674659 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 551/1107] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:11:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:11:40.335489 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1dcd8-bfae-46c7-9d86-e104fbcbe9da None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:40.336072 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1dcd8-bfae-46c7-9d86-e104fbcbe9da None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:40.336072 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1dcd8-bfae-46c7-9d86-e104fbcbe9da None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:40.337385 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 557/1108] 10.222.0.15 () {54 vars in 927 bytes} [Tue Sep 13 12:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:11:40.342657 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0ab02-93b8-49e5-8008-ff8bfdbac812 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:40.343094 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0ab02-93b8-49e5-8008-ff8bfdbac812 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:40.343208 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0ab02-93b8-49e5-8008-ff8bfdbac812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:40.364025 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-6fe0ab02-93b8-49e5-8008-ff8bfdbac812 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:11:40.365262 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-6fe0ab02-93b8-49e5-8008-ff8bfdbac812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:11:40.373871 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 552/1109] 10.222.0.15 () {58 vars in 1024 bytes} [Tue Sep 13 12:11:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:11:40.718262 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1dcd8-bfae-46c7-9d86-e104fbcbe9da None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:11:40.728989 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1dcd8-bfae-46c7-9d86-e104fbcbe9da None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:11:40.733517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac5ae2-795d-435e-9438-1bde5c31ea09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:11:40.734097 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac5ae2-795d-435e-9438-1bde5c31ea09 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:11:40.734371 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac5ae2-795d-435e-9438-1bde5c31ea09 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:11:40.734659 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac5ae2-795d-435e-9438-1bde5c31ea09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:11:40.743458 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac5ae2-795d-435e-9438-1bde5c31ea09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:11:40.744865 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac5ae2-795d-435e-9438-1bde5c31ea09 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:11:40.754464 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 558/1110] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:11:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:11:50.358936 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=33 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:11:50.750418 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=33 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:12:59.685119 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f1b89-db04-4041-9e26-2f35b8af4505 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:12:59.685742 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f1b89-db04-4041-9e26-2f35b8af4505 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:12:59.685742 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f1b89-db04-4041-9e26-2f35b8af4505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:12:59.758712 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-e61f1b89-db04-4041-9e26-2f35b8af4505 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:12:59.759945 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-e61f1b89-db04-4041-9e26-2f35b8af4505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:12:59.806321 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 553/1111] 10.222.0.15 () {58 vars in 958 bytes} [Tue Sep 13 12:12:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:12:59.814807 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefea04-068d-4a1e-ae97-77130f25c883 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:12:59.815377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefea04-068d-4a1e-ae97-77130f25c883 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:12:59.815377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefea04-068d-4a1e-ae97-77130f25c883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:12:59.836275 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-6fefea04-068d-4a1e-ae97-77130f25c883 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:12:59.837497 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-6fefea04-068d-4a1e-ae97-77130f25c883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:12:59.846172 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 559/1112] 10.222.0.15 () {58 vars in 958 bytes} [Tue Sep 13 12:12:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:12:59.850839 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f1b89-db04-4041-9e26-2f35b8af4505 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:12:59.861209 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f1b89-db04-4041-9e26-2f35b8af4505 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:12:59.865857 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb62e3-3ea6-40f5-aa0f-78ca5d989fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:12:59.866450 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb62e3-3ea6-40f5-aa0f-78ca5d989fda admin admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:12:59.866757 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb62e3-3ea6-40f5-aa0f-78ca5d989fda admin admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:12:59.867056 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb62e3-3ea6-40f5-aa0f-78ca5d989fda admin admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:12:59.867695 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb62e3-3ea6-40f5-aa0f-78ca5d989fda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:12:59.867996 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb62e3-3ea6-40f5-aa0f-78ca5d989fda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:12:59.868992 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: WARNING py.warnings [None req-a3cb62e3-3ea6-40f5-aa0f-78ca5d989fda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:12:59.868992 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: warnings.warn(msg) Sep 13 12:12:59.868992 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: Sep 13 12:12:59.869961 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb62e3-3ea6-40f5-aa0f-78ca5d989fda admin admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:12:59.883299 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 554/1113] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Sep 13 12:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:12:59.892426 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefea04-068d-4a1e-ae97-77130f25c883 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:12:59.902659 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefea04-068d-4a1e-ae97-77130f25c883 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:12:59.907995 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6dc69b-da4c-4c84-a08d-b32626dea66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:12:59.908613 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dc69b-da4c-4c84-a08d-b32626dea66d admin admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:12:59.908888 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dc69b-da4c-4c84-a08d-b32626dea66d admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:12:59.909159 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dc69b-da4c-4c84-a08d-b32626dea66d admin admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:12:59.909834 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6dc69b-da4c-4c84-a08d-b32626dea66d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:12:59.911667 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: WARNING py.warnings [None req-ff6dc69b-da4c-4c84-a08d-b32626dea66d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:12:59.911667 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: warnings.warn(msg) Sep 13 12:12:59.911667 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: Sep 13 12:12:59.913160 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6dc69b-da4c-4c84-a08d-b32626dea66d admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:12:59.953603 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 560/1114] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Sep 13 12:12:59 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:12:59.958071 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb62e3-3ea6-40f5-aa0f-78ca5d989fda admin admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:12:59.970379 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb62e3-3ea6-40f5-aa0f-78ca5d989fda admin admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:13:00.035987 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7931b4-f620-4fc4-af70-7ee2ddaff658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:13:00.036600 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7931b4-f620-4fc4-af70-7ee2ddaff658 admin admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:00.036883 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7931b4-f620-4fc4-af70-7ee2ddaff658 admin admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:00.037442 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7931b4-f620-4fc4-af70-7ee2ddaff658 admin admin] PATH_INFO: `/v3/users` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:00.038084 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7931b4-f620-4fc4-af70-7ee2ddaff658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:13:00.039135 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: WARNING py.warnings [None req-7b7931b4-f620-4fc4-af70-7ee2ddaff658 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:13:00.039135 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: warnings.warn(msg) Sep 13 12:13:00.039135 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: Sep 13 12:13:00.040344 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7931b4-f620-4fc4-af70-7ee2ddaff658 admin admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:13:00.062149 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 555/1115] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Sep 13 12:12:59 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:13:00.066267 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6dc69b-da4c-4c84-a08d-b32626dea66d admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:13:00.077641 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6dc69b-da4c-4c84-a08d-b32626dea66d admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:13:00.082242 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19a198-420e-4668-8f28-f6bcd2d7fb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:13:00.082971 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19a198-420e-4668-8f28-f6bcd2d7fb30 admin admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:00.083250 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19a198-420e-4668-8f28-f6bcd2d7fb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:00.083551 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19a198-420e-4668-8f28-f6bcd2d7fb30 admin admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:00.084172 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19a198-420e-4668-8f28-f6bcd2d7fb30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:13:00.085181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: WARNING py.warnings [None req-df19a198-420e-4668-8f28-f6bcd2d7fb30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:13:00.085181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: warnings.warn(msg) Sep 13 12:13:00.085181 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: Sep 13 12:13:00.086081 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19a198-420e-4668-8f28-f6bcd2d7fb30 admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:13:00.099747 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 561/1116] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Sep 13 12:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:13:00.104390 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7931b4-f620-4fc4-af70-7ee2ddaff658 admin admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:13:00.115453 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7931b4-f620-4fc4-af70-7ee2ddaff658 admin admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:13:00.120771 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d3c91-c93c-4bc8-b738-aac2003abbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:13:00.121378 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d3c91-c93c-4bc8-b738-aac2003abbb6 admin admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:00.121657 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d3c91-c93c-4bc8-b738-aac2003abbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:00.121959 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d3c91-c93c-4bc8-b738-aac2003abbb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:00.122599 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d3c91-c93c-4bc8-b738-aac2003abbb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:13:00.123644 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: WARNING py.warnings [None req-6d3d3c91-c93c-4bc8-b738-aac2003abbb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:13:00.123644 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: warnings.warn(msg) Sep 13 12:13:00.123644 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: Sep 13 12:13:00.124533 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d3c91-c93c-4bc8-b738-aac2003abbb6 admin admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:13:00.138964 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 556/1117] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Sep 13 12:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:13:00.143438 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19a198-420e-4668-8f28-f6bcd2d7fb30 admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:13:00.153540 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19a198-420e-4668-8f28-f6bcd2d7fb30 admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:13:00.158126 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd5d05-05d6-4ea0-9bfa-c15c6415f148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:13:00.158821 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd5d05-05d6-4ea0-9bfa-c15c6415f148 admin admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:00.159107 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd5d05-05d6-4ea0-9bfa-c15c6415f148 admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:00.159387 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd5d05-05d6-4ea0-9bfa-c15c6415f148 admin admin] PATH_INFO: `/v3/projects/28aa922fe7c34e77afbb62e13c245734/users/54f30957f0624a408b6085df1ff97ac9/roles/ab14a68bf5b54561badd35b83e6acaf5` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:00.176259 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd5d05-05d6-4ea0-9bfa-c15c6415f148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28aa922fe7c34e77afbb62e13c245734, user_id=54f30957f0624a408b6085df1ff97ac9, role_id=ab14a68bf5b54561badd35b83e6acaf5)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:13:00.177284 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: WARNING py.warnings [None req-abbd5d05-05d6-4ea0-9bfa-c15c6415f148 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:13:00.177284 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: warnings.warn(msg) Sep 13 12:13:00.177284 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: Sep 13 12:13:00.179238 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd5d05-05d6-4ea0-9bfa-c15c6415f148 admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:13:00.193602 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 562/1118] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Sep 13 12:13:00 2022] PUT /identity/v3/projects/28aa922fe7c34e77afbb62e13c245734/users/54f30957f0624a408b6085df1ff97ac9/roles/ab14a68bf5b54561badd35b83e6acaf5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:13:00.206756 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcebb5-fd54-4ed3-9189-edf2e5e03cab None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:00.207001 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcebb5-fd54-4ed3-9189-edf2e5e03cab None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:00.207352 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcebb5-fd54-4ed3-9189-edf2e5e03cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:00.239894 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-d3bcebb5-fd54-4ed3-9189-edf2e5e03cab None None] MFA Rules not processed for user `54f30957f0624a408b6085df1ff97ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:13:00.241121 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-d3bcebb5-fd54-4ed3-9189-edf2e5e03cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:13:00.277084 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:13:00.320868 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 557/1119] 10.222.0.15 () {58 vars in 958 bytes} [Tue Sep 13 12:13:00 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:13:00.335289 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097823f-1221-4d12-a70a-4cfc83361d7b None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:00.335601 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097823f-1221-4d12-a70a-4cfc83361d7b None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:00.335903 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097823f-1221-4d12-a70a-4cfc83361d7b None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:00.337262 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 563/1120] 10.222.0.15 () {54 vars in 964 bytes} [Tue Sep 13 12:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 12:13:00.342417 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6b16c-1ca8-4eac-a4df-c3c6abe88729 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:00.342765 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6b16c-1ca8-4eac-a4df-c3c6abe88729 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:00.343042 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6b16c-1ca8-4eac-a4df-c3c6abe88729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:00.365285 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-39c6b16c-1ca8-4eac-a4df-c3c6abe88729 None None] MFA Rules not processed for user `06cb1e39f474441495bc09988786a84a`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:13:00.366496 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-39c6b16c-1ca8-4eac-a4df-c3c6abe88729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:13:00.419982 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 558/1121] 10.222.0.15 () {58 vars in 1061 bytes} [Tue Sep 13 12:13:00 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:13:00.427690 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097823f-1221-4d12-a70a-4cfc83361d7b None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:13:00.439179 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097823f-1221-4d12-a70a-4cfc83361d7b None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:13:00.442669 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb89b4-6878-49d6-b311-d9e49b155710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06cb1e39f474441495bc09988786a84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:13:00.443263 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb89b4-6878-49d6-b311-d9e49b155710 service cinder] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:00.443545 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb89b4-6878-49d6-b311-d9e49b155710 service cinder] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:00.443814 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb89b4-6878-49d6-b311-d9e49b155710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:00.453196 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb89b4-6878-49d6-b311-d9e49b155710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:13:00.454656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb89b4-6878-49d6-b311-d9e49b155710 service cinder] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:13:00.463813 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 564/1122] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:13:00 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:13:00.509020 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614e06c-05f1-49a9-a70b-ae19071be59f None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:00.509301 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614e06c-05f1-49a9-a70b-ae19071be59f None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:00.509576 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614e06c-05f1-49a9-a70b-ae19071be59f None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:00.511185 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 559/1123] 10.222.0.15 () {52 vars in 830 bytes} [Tue Sep 13 12:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:13:00.514859 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb89b4-6878-49d6-b311-d9e49b155710 service cinder] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:13:00.586304 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb89b4-6878-49d6-b311-d9e49b155710 service cinder] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:13:00.591058 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb811c-ab59-4f91-a736-d8c6f3afd647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:13:00.591696 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb811c-ab59-4f91-a736-d8c6f3afd647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:00.591972 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb811c-ab59-4f91-a736-d8c6f3afd647 admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:00.592247 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb811c-ab59-4f91-a736-d8c6f3afd647 admin admin] PATH_INFO: `/v3/users/54f30957f0624a408b6085df1ff97ac9` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:00.593389 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb811c-ab59-4f91-a736-d8c6f3afd647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f30957f0624a408b6085df1ff97ac9)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:13:00.594399 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: WARNING py.warnings [None req-fbcb811c-ab59-4f91-a736-d8c6f3afd647 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:13:00.594399 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: warnings.warn(msg) Sep 13 12:13:00.594399 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: Sep 13 12:13:00.595640 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb811c-ab59-4f91-a736-d8c6f3afd647 admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:13:00.675227 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-fbcb811c-ab59-4f91-a736-d8c6f3afd647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f30957f0624a408b6085df1ff97ac9'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:13:00.676030 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-fbcb811c-ab59-4f91-a736-d8c6f3afd647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f30957f0624a408b6085df1ff97ac9'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:13:00.688934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-fbcb811c-ab59-4f91-a736-d8c6f3afd647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f30957f0624a408b6085df1ff97ac9'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:13:00.689570 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-fbcb811c-ab59-4f91-a736-d8c6f3afd647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f30957f0624a408b6085df1ff97ac9'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:13:00.718002 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-fbcb811c-ab59-4f91-a736-d8c6f3afd647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f30957f0624a408b6085df1ff97ac9'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:13:00.728535 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:13:00.741239 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 565/1124] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Sep 13 12:13:00 2022] DELETE /identity/v3/users/54f30957f0624a408b6085df1ff97ac9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:13:00.746079 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded8872-76c8-4631-8f5d-93b0ad0bbbc4 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:00.746698 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded8872-76c8-4631-8f5d-93b0ad0bbbc4 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:00.746698 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded8872-76c8-4631-8f5d-93b0ad0bbbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:00.766012 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-aded8872-76c8-4631-8f5d-93b0ad0bbbc4 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:13:00.767272 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-aded8872-76c8-4631-8f5d-93b0ad0bbbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:13:00.829155 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 560/1125] 10.222.0.15 () {58 vars in 958 bytes} [Tue Sep 13 12:13:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:13:00.839798 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb811c-ab59-4f91-a736-d8c6f3afd647 admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:13:00.841234 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-fbcb811c-ab59-4f91-a736-d8c6f3afd647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:13:00.899852 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb811c-ab59-4f91-a736-d8c6f3afd647 admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:13:00.904293 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ca8d3-bed4-4c5a-bdf4-3bd957d85d39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:13:00.904915 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ca8d3-bed4-4c5a-bdf4-3bd957d85d39 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:00.905193 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ca8d3-bed4-4c5a-bdf4-3bd957d85d39 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:00.905471 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ca8d3-bed4-4c5a-bdf4-3bd957d85d39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:00.915473 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ca8d3-bed4-4c5a-bdf4-3bd957d85d39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:13:00.917543 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ca8d3-bed4-4c5a-bdf4-3bd957d85d39 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:13:00.927823 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 566/1126] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:13:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:13:01.283555 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded8872-76c8-4631-8f5d-93b0ad0bbbc4 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:13:01.285217 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-aded8872-76c8-4631-8f5d-93b0ad0bbbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:13:01.299359 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded8872-76c8-4631-8f5d-93b0ad0bbbc4 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:13:01.305881 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec50e06-cd15-4e9b-9b55-325e10bccc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:13:01.306875 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec50e06-cd15-4e9b-9b55-325e10bccc37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:13:01.307374 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec50e06-cd15-4e9b-9b55-325e10bccc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:13:01.307738 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec50e06-cd15-4e9b-9b55-325e10bccc37 admin admin] PATH_INFO: `/v3/projects/28aa922fe7c34e77afbb62e13c245734` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:13:01.309183 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec50e06-cd15-4e9b-9b55-325e10bccc37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28aa922fe7c34e77afbb62e13c245734)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:13:01.310926 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: WARNING py.warnings [None req-fec50e06-cd15-4e9b-9b55-325e10bccc37 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:13:01.310926 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: warnings.warn(msg) Sep 13 12:13:01.310926 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: Sep 13 12:13:01.313078 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec50e06-cd15-4e9b-9b55-325e10bccc37 admin admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:13:01.387788 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-fec50e06-cd15-4e9b-9b55-325e10bccc37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28aa922fe7c34e77afbb62e13c245734', 'request_id': 'req-fec50e06-cd15-4e9b-9b55-325e10bccc37'} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:13:01.402192 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-fec50e06-cd15-4e9b-9b55-325e10bccc37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28aa922fe7c34e77afbb62e13c245734', 'request_id': 'req-fec50e06-cd15-4e9b-9b55-325e10bccc37'} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:13:01.412914 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-fec50e06-cd15-4e9b-9b55-325e10bccc37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28aa922fe7c34e77afbb62e13c245734', 'request_id': 'req-fec50e06-cd15-4e9b-9b55-325e10bccc37'} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:13:01.424435 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-fec50e06-cd15-4e9b-9b55-325e10bccc37 admin admin] The token cache is being invalidate because project 28aa922fe7c34e77afbb62e13c245734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:13:01.424719 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-fec50e06-cd15-4e9b-9b55-325e10bccc37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:13:01.425466 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-fec50e06-cd15-4e9b-9b55-325e10bccc37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:13:01.427308 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 561/1127] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Sep 13 12:13:01 2022] DELETE /identity/v3/projects/28aa922fe7c34e77afbb62e13c245734 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:13:10.923275 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=29 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:13:11.421321 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:14:29.910112 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff7708-b602-48c3-aa8e-2f1d32451109 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:29.910748 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff7708-b602-48c3-aa8e-2f1d32451109 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:29.910748 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff7708-b602-48c3-aa8e-2f1d32451109 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:29.912066 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 567/1128] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:14:29.917479 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f145245-ef10-449e-a16f-b7fb035964b5 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:29.917979 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f145245-ef10-449e-a16f-b7fb035964b5 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:29.918170 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f145245-ef10-449e-a16f-b7fb035964b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:29.937612 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-7f145245-ef10-449e-a16f-b7fb035964b5 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:14:29.938779 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-7f145245-ef10-449e-a16f-b7fb035964b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:30.000838 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 562/1129] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:14:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:14:30.163692 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff7708-b602-48c3-aa8e-2f1d32451109 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:14:30.165708 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-50ff7708-b602-48c3-aa8e-2f1d32451109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:30.260000 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff7708-b602-48c3-aa8e-2f1d32451109 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:14:30.264780 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd04c4-a23e-4053-9130-cf11a27627a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:14:30.265401 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd04c4-a23e-4053-9130-cf11a27627a5 service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:30.265682 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd04c4-a23e-4053-9130-cf11a27627a5 service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:30.265956 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd04c4-a23e-4053-9130-cf11a27627a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:30.274903 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd04c4-a23e-4053-9130-cf11a27627a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:14:30.276515 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd04c4-a23e-4053-9130-cf11a27627a5 service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:14:30.286139 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 568/1130] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:14:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:14:31.961323 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87735c2-c632-4904-a596-f88fb98a27c2 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:31.961880 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87735c2-c632-4904-a596-f88fb98a27c2 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:31.961880 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87735c2-c632-4904-a596-f88fb98a27c2 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:31.963296 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 563/1131] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:14:31.968082 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe27e1f-dcc3-4720-b4fd-3e4ca6c9b140 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:31.968506 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe27e1f-dcc3-4720-b4fd-3e4ca6c9b140 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:31.968628 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe27e1f-dcc3-4720-b4fd-3e4ca6c9b140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:31.988399 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-dbe27e1f-dcc3-4720-b4fd-3e4ca6c9b140 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:14:31.989615 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-dbe27e1f-dcc3-4720-b4fd-3e4ca6c9b140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:31.998105 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 569/1132] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:14:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:14:32.158587 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87735c2-c632-4904-a596-f88fb98a27c2 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:14:32.173506 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87735c2-c632-4904-a596-f88fb98a27c2 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:14:32.178503 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a4b40-955f-42f4-8d03-f0dfa667114e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:14:32.179128 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a4b40-955f-42f4-8d03-f0dfa667114e service nova] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:32.179411 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a4b40-955f-42f4-8d03-f0dfa667114e service nova] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:32.179688 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a4b40-955f-42f4-8d03-f0dfa667114e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:32.188908 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a4b40-955f-42f4-8d03-f0dfa667114e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:14:32.190511 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a4b40-955f-42f4-8d03-f0dfa667114e service nova] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:14:32.200730 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 564/1133] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:14:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:14:34.105293 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d47809-fe5d-4d06-8223-252e4ec97cff None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:34.105845 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d47809-fe5d-4d06-8223-252e4ec97cff None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:34.105958 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d47809-fe5d-4d06-8223-252e4ec97cff None None] PATH_INFO: `/v3` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:34.107273 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 570/1134] 10.222.0.27 () {54 vars in 925 bytes} [Tue Sep 13 12:14:34 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:14:34.113040 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30c1bc-a75d-45a9-b454-7d5112522486 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:34.113504 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30c1bc-a75d-45a9-b454-7d5112522486 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:34.113617 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30c1bc-a75d-45a9-b454-7d5112522486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:34.143566 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-ff30c1bc-a75d-45a9-b454-7d5112522486 None None] MFA Rules not processed for user `e72796c5d7864bd8887419c60e3bbc1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:14:34.144763 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-ff30c1bc-a75d-45a9-b454-7d5112522486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:34.208939 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 565/1135] 10.222.0.27 () {58 vars in 1015 bytes} [Tue Sep 13 12:14:34 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:14:41.983643 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=42 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:14:43.108371 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710ea81-261c-443e-ad89-f37a5c4f6546 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:43.108915 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710ea81-261c-443e-ad89-f37a5c4f6546 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:43.108915 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710ea81-261c-443e-ad89-f37a5c4f6546 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:43.110253 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 571/1136] 10.222.0.15 () {54 vars in 961 bytes} [Tue Sep 13 12:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:14:43.116616 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d055306-bb1d-4f43-9af2-7d06297bfe86 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:43.117073 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d055306-bb1d-4f43-9af2-7d06297bfe86 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:43.117324 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d055306-bb1d-4f43-9af2-7d06297bfe86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:43.138303 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-6d055306-bb1d-4f43-9af2-7d06297bfe86 None None] MFA Rules not processed for user `e72796c5d7864bd8887419c60e3bbc1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:14:43.139539 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-6d055306-bb1d-4f43-9af2-7d06297bfe86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:43.147909 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 566/1137] 10.222.0.15 () {58 vars in 1058 bytes} [Tue Sep 13 12:14:43 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:14:43.155247 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710ea81-261c-443e-ad89-f37a5c4f6546 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:14:43.169306 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710ea81-261c-443e-ad89-f37a5c4f6546 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:14:43.174280 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b5441-174b-4207-8f5c-afa5220e97f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72796c5d7864bd8887419c60e3bbc1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:14:43.174914 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b5441-174b-4207-8f5c-afa5220e97f4 service placement] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:43.175193 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b5441-174b-4207-8f5c-afa5220e97f4 service placement] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:43.175463 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b5441-174b-4207-8f5c-afa5220e97f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:43.184391 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b5441-174b-4207-8f5c-afa5220e97f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:14:43.185954 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b5441-174b-4207-8f5c-afa5220e97f4 service placement] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:14:43.195544 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 572/1138] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:14:43 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:14:44.399282 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f67da4-734a-4931-a20f-90e1d621c251 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:44.399825 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f67da4-734a-4931-a20f-90e1d621c251 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:44.399985 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f67da4-734a-4931-a20f-90e1d621c251 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:44.401309 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 567/1139] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:14:44.406207 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f1ff6-ec2c-45e0-9507-a363f45327e9 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:44.406659 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f1ff6-ec2c-45e0-9507-a363f45327e9 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:44.406794 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f1ff6-ec2c-45e0-9507-a363f45327e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:44.426172 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-b14f1ff6-ec2c-45e0-9507-a363f45327e9 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:14:44.427399 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-b14f1ff6-ec2c-45e0-9507-a363f45327e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:44.441109 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 573/1140] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:14:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:14:44.610398 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f67da4-734a-4931-a20f-90e1d621c251 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:14:44.625268 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f67da4-734a-4931-a20f-90e1d621c251 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:14:44.630160 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f1272-15f8-45cb-8434-8288b696e34c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:14:44.630797 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f1272-15f8-45cb-8434-8288b696e34c service nova] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:44.631072 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f1272-15f8-45cb-8434-8288b696e34c service nova] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:44.631340 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f1272-15f8-45cb-8434-8288b696e34c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:44.639749 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f1272-15f8-45cb-8434-8288b696e34c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:14:44.641324 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f1272-15f8-45cb-8434-8288b696e34c service nova] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:14:44.650589 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 568/1141] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:14:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:14:46.294955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091dc442-e041-4ab6-aa51-017a023bd8cb None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:46.295521 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091dc442-e041-4ab6-aa51-017a023bd8cb None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:46.295521 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091dc442-e041-4ab6-aa51-017a023bd8cb None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:46.296867 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 574/1142] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 12:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:14:46.301781 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11affc1f-3589-4602-b0f7-014bf8188532 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:46.302241 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11affc1f-3589-4602-b0f7-014bf8188532 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:46.302337 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11affc1f-3589-4602-b0f7-014bf8188532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:46.323581 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-11affc1f-3589-4602-b0f7-014bf8188532 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:14:46.324768 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-11affc1f-3589-4602-b0f7-014bf8188532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:46.332451 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 569/1143] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 12:14:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:14:46.494091 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091dc442-e041-4ab6-aa51-017a023bd8cb None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:14:46.507771 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091dc442-e041-4ab6-aa51-017a023bd8cb None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:14:46.513802 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68639ed1-f823-43eb-abf7-665ecf30b248 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:14:46.514366 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68639ed1-f823-43eb-abf7-665ecf30b248 service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:46.514681 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68639ed1-f823-43eb-abf7-665ecf30b248 service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:46.514957 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68639ed1-f823-43eb-abf7-665ecf30b248 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:46.523011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68639ed1-f823-43eb-abf7-665ecf30b248 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:14:46.524791 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68639ed1-f823-43eb-abf7-665ecf30b248 service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:14:46.534503 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 575/1144] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:14:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:14:51.131068 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149b09b-7a9a-4ed8-afd9-905ca03aa7af None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:51.131658 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149b09b-7a9a-4ed8-afd9-905ca03aa7af None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:51.131658 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149b09b-7a9a-4ed8-afd9-905ca03aa7af None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:51.132940 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 570/1145] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:14:51.138274 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597294b-d481-4fda-a2db-484cc0e07ba4 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:51.138713 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597294b-d481-4fda-a2db-484cc0e07ba4 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:51.138867 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597294b-d481-4fda-a2db-484cc0e07ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:51.159893 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-a597294b-d481-4fda-a2db-484cc0e07ba4 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:14:51.161083 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-a597294b-d481-4fda-a2db-484cc0e07ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:51.169753 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 576/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:14:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:14:51.512803 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149b09b-7a9a-4ed8-afd9-905ca03aa7af None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:14:51.514539 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-9149b09b-7a9a-4ed8-afd9-905ca03aa7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:51.518673 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=79 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:14:51.584352 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149b09b-7a9a-4ed8-afd9-905ca03aa7af None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:14:51.588763 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e499bb-5e1c-4d64-8117-bac46e36109c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:14:51.589613 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e499bb-5e1c-4d64-8117-bac46e36109c service neutron] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:51.589897 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e499bb-5e1c-4d64-8117-bac46e36109c service neutron] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:51.590298 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e499bb-5e1c-4d64-8117-bac46e36109c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:51.600474 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e499bb-5e1c-4d64-8117-bac46e36109c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:14:51.601903 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e499bb-5e1c-4d64-8117-bac46e36109c service neutron] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:14:51.611671 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 571/1147] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:14:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:14:54.037556 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5307f8-c835-4f55-bb59-f00d001758ce None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:54.038093 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5307f8-c835-4f55-bb59-f00d001758ce None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:54.038202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5307f8-c835-4f55-bb59-f00d001758ce None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:54.039952 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 577/1148] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:14:54.045187 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40cdef-7768-484c-92fe-f8d12ad1c42e None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:54.045631 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40cdef-7768-484c-92fe-f8d12ad1c42e None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:54.045747 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40cdef-7768-484c-92fe-f8d12ad1c42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:54.066323 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-7c40cdef-7768-484c-92fe-f8d12ad1c42e None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:14:54.067544 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-7c40cdef-7768-484c-92fe-f8d12ad1c42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:54.076099 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 572/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:14:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:14:54.414020 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5307f8-c835-4f55-bb59-f00d001758ce None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:14:54.416517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-5e5307f8-c835-4f55-bb59-f00d001758ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:54.429575 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5307f8-c835-4f55-bb59-f00d001758ce None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:14:54.433784 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d110d4-a2dc-4079-a7d9-1776467b88a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:14:54.434365 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d110d4-a2dc-4079-a7d9-1776467b88a4 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:54.434668 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d110d4-a2dc-4079-a7d9-1776467b88a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:54.434942 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d110d4-a2dc-4079-a7d9-1776467b88a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:54.443505 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d110d4-a2dc-4079-a7d9-1776467b88a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:14:54.444912 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d110d4-a2dc-4079-a7d9-1776467b88a4 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:14:54.454114 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 578/1150] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:14:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:14:58.631318 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca256a3f-b41d-4a6e-a9e1-4ed6e490bdfe None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:58.631903 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca256a3f-b41d-4a6e-a9e1-4ed6e490bdfe None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:58.631903 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca256a3f-b41d-4a6e-a9e1-4ed6e490bdfe None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:58.634663 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 573/1151] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:14:58.639605 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abceb277-9d45-4ea0-a398-5ed59a66871a None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:58.640048 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abceb277-9d45-4ea0-a398-5ed59a66871a None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:58.640158 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abceb277-9d45-4ea0-a398-5ed59a66871a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:58.659538 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-abceb277-9d45-4ea0-a398-5ed59a66871a None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:14:58.660731 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-abceb277-9d45-4ea0-a398-5ed59a66871a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:58.669058 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 579/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:14:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:14:59.030227 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca256a3f-b41d-4a6e-a9e1-4ed6e490bdfe None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:14:59.032080 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-ca256a3f-b41d-4a6e-a9e1-4ed6e490bdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:14:59.100908 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca256a3f-b41d-4a6e-a9e1-4ed6e490bdfe None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:14:59.105130 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a52a2c-610b-4a1e-8c33-b7930dfafa6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06cb1e39f474441495bc09988786a84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:14:59.105727 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a52a2c-610b-4a1e-8c33-b7930dfafa6b service cinder] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:14:59.106006 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a52a2c-610b-4a1e-8c33-b7930dfafa6b service cinder] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:14:59.106276 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a52a2c-610b-4a1e-8c33-b7930dfafa6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:14:59.114985 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a52a2c-610b-4a1e-8c33-b7930dfafa6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:14:59.116398 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a52a2c-610b-4a1e-8c33-b7930dfafa6b service cinder] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:14:59.126441 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 574/1153] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:14:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:15:01.543578 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dfceb-af66-47bc-8cb6-0fbbb8ed55f6 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:01.544142 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dfceb-af66-47bc-8cb6-0fbbb8ed55f6 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:01.544142 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dfceb-af66-47bc-8cb6-0fbbb8ed55f6 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:01.545445 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 580/1154] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 12:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:15:01.551017 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e31a0-1901-47e0-b33b-3210130aff60 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:01.551435 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e31a0-1901-47e0-b33b-3210130aff60 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:01.551541 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e31a0-1901-47e0-b33b-3210130aff60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:01.570998 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-772e31a0-1901-47e0-b33b-3210130aff60 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:15:01.572387 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-772e31a0-1901-47e0-b33b-3210130aff60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:01.580129 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 575/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 12:15:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:15:01.940227 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dfceb-af66-47bc-8cb6-0fbbb8ed55f6 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:15:01.941888 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-e24dfceb-af66-47bc-8cb6-0fbbb8ed55f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:15:01.955528 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dfceb-af66-47bc-8cb6-0fbbb8ed55f6 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:15:01.959079 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9950d-290f-40e8-91ed-330f4342fdd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06cb1e39f474441495bc09988786a84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:15:01.959672 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9950d-290f-40e8-91ed-330f4342fdd1 service cinder] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:15:01.959955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9950d-290f-40e8-91ed-330f4342fdd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:15:01.960232 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9950d-290f-40e8-91ed-330f4342fdd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:15:01.969903 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9950d-290f-40e8-91ed-330f4342fdd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:15:01.971346 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9950d-290f-40e8-91ed-330f4342fdd1 service cinder] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:15:01.980747 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 581/1156] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:15:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:15:11.566022 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=67 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:15:11.976498 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=33 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:17.221047 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa4a08-51e0-4b5d-8e81-f04beac60b7e None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.221678 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa4a08-51e0-4b5d-8e81-f04beac60b7e None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.221678 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa4a08-51e0-4b5d-8e81-f04beac60b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.229458 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a2d3c-8f7d-4963-9636-093fe40dc8ec None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.229960 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a2d3c-8f7d-4963-9636-093fe40dc8ec None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.230065 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a2d3c-8f7d-4963-9636-093fe40dc8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.241521 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-10fa4a08-51e0-4b5d-8e81-f04beac60b7e None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:17.249786 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-093a2d3c-8f7d-4963-9636-093fe40dc8ec None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:17.252549 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-10fa4a08-51e0-4b5d-8e81-f04beac60b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:17.252703 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-093a2d3c-8f7d-4963-9636-093fe40dc8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:17.260361 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 576/1157] 10.222.0.15 () {58 vars in 958 bytes} [Tue Sep 13 12:16:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:17.260732 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 582/1158] 10.222.0.15 () {58 vars in 958 bytes} [Tue Sep 13 12:16:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:16:17.269317 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030e790-69f8-4b2f-912c-386ffb43480d None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.269481 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99dd8f-2f13-40d7-bb64-1b473f74ab46 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.269586 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99dd8f-2f13-40d7-bb64-1b473f74ab46 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.269690 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030e790-69f8-4b2f-912c-386ffb43480d None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.269854 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99dd8f-2f13-40d7-bb64-1b473f74ab46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.269967 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030e790-69f8-4b2f-912c-386ffb43480d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.289122 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-c030e790-69f8-4b2f-912c-386ffb43480d None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:17.289333 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-0c99dd8f-2f13-40d7-bb64-1b473f74ab46 None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:17.290318 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-0c99dd8f-2f13-40d7-bb64-1b473f74ab46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:17.290739 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-c030e790-69f8-4b2f-912c-386ffb43480d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:17.298743 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 583/1159] 10.222.0.15 () {58 vars in 958 bytes} [Tue Sep 13 12:16:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:17.298886 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 577/1160] 10.222.0.15 () {58 vars in 958 bytes} [Tue Sep 13 12:16:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:17.302968 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99dd8f-2f13-40d7-bb64-1b473f74ab46 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:17.303154 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030e790-69f8-4b2f-912c-386ffb43480d None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:17.313229 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99dd8f-2f13-40d7-bb64-1b473f74ab46 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:17.313429 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030e790-69f8-4b2f-912c-386ffb43480d None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:17.317948 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a55891-feea-4443-aed3-c933133a4ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:17.318337 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d4b06-5945-4af6-9a05-41a3a5e31e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:17.318537 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a55891-feea-4443-aed3-c933133a4ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.318923 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a55891-feea-4443-aed3-c933133a4ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.319045 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d4b06-5945-4af6-9a05-41a3a5e31e56 admin admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.319146 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a55891-feea-4443-aed3-c933133a4ca1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.319242 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d4b06-5945-4af6-9a05-41a3a5e31e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.319504 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d4b06-5945-4af6-9a05-41a3a5e31e56 admin admin] PATH_INFO: `/v3/domains` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.319752 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a55891-feea-4443-aed3-c933133a4ca1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88356) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:17.320053 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a55891-feea-4443-aed3-c933133a4ca1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:17.320154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d4b06-5945-4af6-9a05-41a3a5e31e56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 12:16:17.320439 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d4b06-5945-4af6-9a05-41a3a5e31e56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:17.321431 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: WARNING py.warnings [None req-041d4b06-5945-4af6-9a05-41a3a5e31e56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:16:17.321431 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: warnings.warn(msg) Sep 13 12:16:17.321431 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: Sep 13 12:16:17.321696 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a55891-feea-4443-aed3-c933133a4ca1 admin admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:17.322326 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d4b06-5945-4af6-9a05-41a3a5e31e56 admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:17.334804 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 578/1161] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Sep 13 12:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 12:16:17.341580 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 584/1162] 10.222.0.15 () {58 vars in 1153 bytes} [Tue Sep 13 12:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 12:16:17.343005 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a55891-feea-4443-aed3-c933133a4ca1 admin admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:17.343746 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d4b06-5945-4af6-9a05-41a3a5e31e56 admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:17.352914 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a55891-feea-4443-aed3-c933133a4ca1 admin admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:17.353239 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d4b06-5945-4af6-9a05-41a3a5e31e56 admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:17.357693 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18a033-0899-4167-8f03-7bdc5a280cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:17.357906 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59561fc-5c93-4844-a2d0-428487cfb36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:17.358277 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18a033-0899-4167-8f03-7bdc5a280cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.358485 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59561fc-5c93-4844-a2d0-428487cfb36f admin admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.358594 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18a033-0899-4167-8f03-7bdc5a280cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.358801 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59561fc-5c93-4844-a2d0-428487cfb36f admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.358917 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18a033-0899-4167-8f03-7bdc5a280cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.359075 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59561fc-5c93-4844-a2d0-428487cfb36f admin admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.359470 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18a033-0899-4167-8f03-7bdc5a280cb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:17.359696 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59561fc-5c93-4844-a2d0-428487cfb36f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:17.360468 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: WARNING py.warnings [None req-fe18a033-0899-4167-8f03-7bdc5a280cb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:16:17.360468 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: warnings.warn(msg) Sep 13 12:16:17.360468 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: Sep 13 12:16:17.361645 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18a033-0899-4167-8f03-7bdc5a280cb1 admin admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:17.361872 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59561fc-5c93-4844-a2d0-428487cfb36f admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:17.391151 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 579/1163] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Sep 13 12:16:17 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:16:17.395285 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 585/1164] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Sep 13 12:16:17 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:16:17.395451 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18a033-0899-4167-8f03-7bdc5a280cb1 admin admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:17.396674 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59561fc-5c93-4844-a2d0-428487cfb36f admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:17.460474 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18a033-0899-4167-8f03-7bdc5a280cb1 admin admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:17.461466 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59561fc-5c93-4844-a2d0-428487cfb36f admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:17.465549 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f0328-246c-4cd4-9dfd-266547c350a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:17.466039 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f41f3-303f-4d91-8427-da1a8fdfcb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:17.466173 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f0328-246c-4cd4-9dfd-266547c350a0 admin admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.466443 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f0328-246c-4cd4-9dfd-266547c350a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.466752 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f0328-246c-4cd4-9dfd-266547c350a0 admin admin] PATH_INFO: `/v3/users` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.467011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f41f3-303f-4d91-8427-da1a8fdfcb5e admin admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.467294 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f41f3-303f-4d91-8427-da1a8fdfcb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.467464 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f0328-246c-4cd4-9dfd-266547c350a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:17.467572 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f41f3-303f-4d91-8427-da1a8fdfcb5e admin admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.468226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f41f3-303f-4d91-8427-da1a8fdfcb5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:17.469195 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: WARNING py.warnings [None req-410f41f3-303f-4d91-8427-da1a8fdfcb5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:16:17.469195 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: warnings.warn(msg) Sep 13 12:16:17.469195 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: Sep 13 12:16:17.469437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f0328-246c-4cd4-9dfd-266547c350a0 admin admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:17.470396 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f41f3-303f-4d91-8427-da1a8fdfcb5e admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:17.495502 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 586/1165] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Sep 13 12:16:17 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:16:17.496620 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 580/1166] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Sep 13 12:16:17 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:16:17.501809 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f41f3-303f-4d91-8427-da1a8fdfcb5e admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:17.502012 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f0328-246c-4cd4-9dfd-266547c350a0 admin admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:17.511526 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f41f3-303f-4d91-8427-da1a8fdfcb5e admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:17.511698 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f0328-246c-4cd4-9dfd-266547c350a0 admin admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:17.516585 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3b1b0-d000-4c1b-9cec-751f8c6d851d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:17.516960 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670e36e-1b75-48c6-9268-cc8b0aaa4a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:17.517174 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3b1b0-d000-4c1b-9cec-751f8c6d851d admin admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.517455 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3b1b0-d000-4c1b-9cec-751f8c6d851d admin admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.517570 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670e36e-1b75-48c6-9268-cc8b0aaa4a7d admin admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.517725 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3b1b0-d000-4c1b-9cec-751f8c6d851d admin admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.517827 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670e36e-1b75-48c6-9268-cc8b0aaa4a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.518063 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670e36e-1b75-48c6-9268-cc8b0aaa4a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.518390 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3b1b0-d000-4c1b-9cec-751f8c6d851d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:17.518760 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670e36e-1b75-48c6-9268-cc8b0aaa4a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:17.520019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3b1b0-d000-4c1b-9cec-751f8c6d851d admin admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:17.520312 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670e36e-1b75-48c6-9268-cc8b0aaa4a7d admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:17.530674 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 581/1167] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Sep 13 12:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:16:17.534325 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3b1b0-d000-4c1b-9cec-751f8c6d851d admin admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:17.538132 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 587/1168] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Sep 13 12:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:16:17.539164 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670e36e-1b75-48c6-9268-cc8b0aaa4a7d admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:17.545284 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3b1b0-d000-4c1b-9cec-751f8c6d851d admin admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:17.549917 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670e36e-1b75-48c6-9268-cc8b0aaa4a7d admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:17.550042 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79b996-8ac3-4164-a780-089c67274320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:17.550565 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79b996-8ac3-4164-a780-089c67274320 admin admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.550937 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79b996-8ac3-4164-a780-089c67274320 admin admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.551237 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79b996-8ac3-4164-a780-089c67274320 admin admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.551851 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79b996-8ac3-4164-a780-089c67274320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:17.553483 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79b996-8ac3-4164-a780-089c67274320 admin admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:17.556289 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc3c44-b89a-41b0-93b0-f3a15683e89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:17.557141 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc3c44-b89a-41b0-93b0-f3a15683e89c admin admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.557453 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc3c44-b89a-41b0-93b0-f3a15683e89c admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.557854 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc3c44-b89a-41b0-93b0-f3a15683e89c admin admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.558677 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc3c44-b89a-41b0-93b0-f3a15683e89c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:17.562859 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc3c44-b89a-41b0-93b0-f3a15683e89c admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:17.566128 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 582/1169] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Sep 13 12:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:16:17.570086 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79b996-8ac3-4164-a780-089c67274320 admin admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:17.575014 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 588/1170] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Sep 13 12:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:16:17.579014 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc3c44-b89a-41b0-93b0-f3a15683e89c admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:17.580796 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79b996-8ac3-4164-a780-089c67274320 admin admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:17.585266 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fc4ee-946f-40cc-adf1-4ebd30ea8f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:17.585901 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fc4ee-946f-40cc-adf1-4ebd30ea8f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.586178 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fc4ee-946f-40cc-adf1-4ebd30ea8f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.586449 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fc4ee-946f-40cc-adf1-4ebd30ea8f3d admin admin] PATH_INFO: `/v3/projects/2fcf0fae057b491482492730be8c4ac0/users/e953d95f49114a278036e290b92102cf/roles/ab14a68bf5b54561badd35b83e6acaf5` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.588777 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc3c44-b89a-41b0-93b0-f3a15683e89c admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:17.593651 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33c159-db1a-43ce-a9cd-ac132842fc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:17.594303 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33c159-db1a-43ce-a9cd-ac132842fc21 admin admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.594655 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33c159-db1a-43ce-a9cd-ac132842fc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.594928 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33c159-db1a-43ce-a9cd-ac132842fc21 admin admin] PATH_INFO: `/v3/projects/03879607b5104726902ffbc115fa25bd/users/3985566453df49a7a5032b946db5fcdb/roles/ab14a68bf5b54561badd35b83e6acaf5` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.601006 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fc4ee-946f-40cc-adf1-4ebd30ea8f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fcf0fae057b491482492730be8c4ac0, user_id=e953d95f49114a278036e290b92102cf, role_id=ab14a68bf5b54561badd35b83e6acaf5)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:17.602027 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: WARNING py.warnings [None req-781fc4ee-946f-40cc-adf1-4ebd30ea8f3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 12:16:17.602027 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: warnings.warn(msg) Sep 13 12:16:17.602027 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: Sep 13 12:16:17.603977 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fc4ee-946f-40cc-adf1-4ebd30ea8f3d admin admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:17.610141 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33c159-db1a-43ce-a9cd-ac132842fc21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03879607b5104726902ffbc115fa25bd, user_id=3985566453df49a7a5032b946db5fcdb, role_id=ab14a68bf5b54561badd35b83e6acaf5)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:17.613088 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33c159-db1a-43ce-a9cd-ac132842fc21 admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:17.619813 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 583/1171] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Sep 13 12:16:17 2022] PUT /identity/v3/projects/2fcf0fae057b491482492730be8c4ac0/users/e953d95f49114a278036e290b92102cf/roles/ab14a68bf5b54561badd35b83e6acaf5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:16:17.626057 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec07aae-46ea-4618-a3df-fe23311c69cc None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.626347 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec07aae-46ea-4618-a3df-fe23311c69cc None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.626640 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec07aae-46ea-4618-a3df-fe23311c69cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.628615 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 589/1172] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Sep 13 12:16:17 2022] PUT /identity/v3/projects/03879607b5104726902ffbc115fa25bd/users/3985566453df49a7a5032b946db5fcdb/roles/ab14a68bf5b54561badd35b83e6acaf5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:16:17.633720 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cc6f7-03e1-4547-b84d-528d7af8c9ec None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.634096 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cc6f7-03e1-4547-b84d-528d7af8c9ec None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.634441 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cc6f7-03e1-4547-b84d-528d7af8c9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.645406 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-7ec07aae-46ea-4618-a3df-fe23311c69cc None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:17.646600 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-7ec07aae-46ea-4618-a3df-fe23311c69cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:17.652934 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-ca5cc6f7-03e1-4547-b84d-528d7af8c9ec None None] MFA Rules not processed for user `e8c852aa86d546e6891e0dac7b3ec7f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:17.654126 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-ca5cc6f7-03e1-4547-b84d-528d7af8c9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:17.698182 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:17.710606 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:17.712374 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 584/1173] 10.222.0.15 () {58 vars in 958 bytes} [Tue Sep 13 12:16:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:17.723247 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec07aae-46ea-4618-a3df-fe23311c69cc None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:17.725644 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 590/1174] 10.222.0.15 () {58 vars in 958 bytes} [Tue Sep 13 12:16:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:16:17.735645 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cc6f7-03e1-4547-b84d-528d7af8c9ec None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:17.780274 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec07aae-46ea-4618-a3df-fe23311c69cc None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:17.784235 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac5d34-46f8-4595-9fa6-c27f4bd38934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:17.784833 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac5d34-46f8-4595-9fa6-c27f4bd38934 service neutron] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.785108 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac5d34-46f8-4595-9fa6-c27f4bd38934 service neutron] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.785381 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac5d34-46f8-4595-9fa6-c27f4bd38934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.795872 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac5d34-46f8-4595-9fa6-c27f4bd38934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:17.797323 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac5d34-46f8-4595-9fa6-c27f4bd38934 service neutron] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:17.798353 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cc6f7-03e1-4547-b84d-528d7af8c9ec None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:17.802504 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7578a-8973-428b-bfa5-0976e4a89b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:17.802701 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7578a-8973-428b-bfa5-0976e4a89b44 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:17.802983 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7578a-8973-428b-bfa5-0976e4a89b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:17.803258 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7578a-8973-428b-bfa5-0976e4a89b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:17.806780 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 585/1175] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:16:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:16:17.813289 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7578a-8973-428b-bfa5-0976e4a89b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:17.814754 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7578a-8973-428b-bfa5-0976e4a89b44 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:17.824274 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 591/1176] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:16:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:16:22.809412 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d14791-1e20-4765-84b5-e355e0600320 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:22.810432 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d14791-1e20-4765-84b5-e355e0600320 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:22.811542 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d14791-1e20-4765-84b5-e355e0600320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:22.892529 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-81d14791-1e20-4765-84b5-e355e0600320 None None] MFA Rules not processed for user `3985566453df49a7a5032b946db5fcdb`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:22.895570 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-81d14791-1e20-4765-84b5-e355e0600320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:23.039643 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 586/1177] 10.222.0.15 () {58 vars in 958 bytes} [Tue Sep 13 12:16:22 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:23.044703 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7578a-8973-428b-bfa5-0976e4a89b44 service neutron] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:23.057473 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7578a-8973-428b-bfa5-0976e4a89b44 service neutron] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:23.071028 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0151a0e-ecb5-4f4b-a9a5-779ee1e2f657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:23.072063 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0151a0e-ecb5-4f4b-a9a5-779ee1e2f657 admin admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:23.072357 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0151a0e-ecb5-4f4b-a9a5-779ee1e2f657 admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:23.072611 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0151a0e-ecb5-4f4b-a9a5-779ee1e2f657 admin admin] PATH_INFO: `/v3/projects` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:23.073264 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0151a0e-ecb5-4f4b-a9a5-779ee1e2f657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:23.075287 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0151a0e-ecb5-4f4b-a9a5-779ee1e2f657 admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:23.142171 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 592/1178] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Sep 13 12:16:23 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:16:23.143435 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d14791-1e20-4765-84b5-e355e0600320 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:23.159668 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d14791-1e20-4765-84b5-e355e0600320 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:23.244200 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db955c22-1184-4937-99af-4643af7b9ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:23.246379 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db955c22-1184-4937-99af-4643af7b9ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:23.246947 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db955c22-1184-4937-99af-4643af7b9ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:23.247821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db955c22-1184-4937-99af-4643af7b9ce0 admin admin] PATH_INFO: `/v3/users` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:23.249097 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db955c22-1184-4937-99af-4643af7b9ce0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:23.251379 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db955c22-1184-4937-99af-4643af7b9ce0 admin admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:23.289803 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 587/1179] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Sep 13 12:16:23 2022] POST /identity/v3/users => generated 299 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:16:23.293164 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0151a0e-ecb5-4f4b-a9a5-779ee1e2f657 admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:23.308133 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0151a0e-ecb5-4f4b-a9a5-779ee1e2f657 admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:23.314862 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f0b5c-f9c0-48d7-bad3-5715bb7daaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:23.315977 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f0b5c-f9c0-48d7-bad3-5715bb7daaf8 admin admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:23.316502 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f0b5c-f9c0-48d7-bad3-5715bb7daaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:23.316988 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f0b5c-f9c0-48d7-bad3-5715bb7daaf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:23.318038 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f0b5c-f9c0-48d7-bad3-5715bb7daaf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:23.319999 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f0b5c-f9c0-48d7-bad3-5715bb7daaf8 admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:23.333946 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 593/1180] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Sep 13 12:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:16:23.338498 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db955c22-1184-4937-99af-4643af7b9ce0 admin admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:23.357310 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db955c22-1184-4937-99af-4643af7b9ce0 admin admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:23.366437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853eb601-a70f-4129-a117-02cbf4f585f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:23.367307 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eb601-a70f-4129-a117-02cbf4f585f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:23.367898 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eb601-a70f-4129-a117-02cbf4f585f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:23.368188 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eb601-a70f-4129-a117-02cbf4f585f3 admin admin] PATH_INFO: `/v3/projects/10b0a81f01f44fa3b9e2952a40e1ca0e/users/50d22281194448f8be1d4e3052be2a25/roles/5609ac7373ba400593bba6d811e3aa72` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:23.389100 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853eb601-a70f-4129-a117-02cbf4f585f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10b0a81f01f44fa3b9e2952a40e1ca0e, user_id=50d22281194448f8be1d4e3052be2a25, role_id=5609ac7373ba400593bba6d811e3aa72)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:23.392224 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853eb601-a70f-4129-a117-02cbf4f585f3 admin admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:23.395091 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:23.426384 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 588/1181] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Sep 13 12:16:23 2022] PUT /identity/v3/projects/10b0a81f01f44fa3b9e2952a40e1ca0e/users/50d22281194448f8be1d4e3052be2a25/roles/5609ac7373ba400593bba6d811e3aa72 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:16:23.430401 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f0b5c-f9c0-48d7-bad3-5715bb7daaf8 admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:23.442602 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f0b5c-f9c0-48d7-bad3-5715bb7daaf8 admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:23.525278 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0e6b1-bfca-4a1d-9b9f-2ece60ca3129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:23.526050 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0e6b1-bfca-4a1d-9b9f-2ece60ca3129 admin admin] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:23.526430 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0e6b1-bfca-4a1d-9b9f-2ece60ca3129 admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:23.526836 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0e6b1-bfca-4a1d-9b9f-2ece60ca3129 admin admin] PATH_INFO: `/v3/roles` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:23.528269 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0e6b1-bfca-4a1d-9b9f-2ece60ca3129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:23.532493 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0e6b1-bfca-4a1d-9b9f-2ece60ca3129 admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:23.546952 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 594/1182] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Sep 13 12:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:16:23.551019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853eb601-a70f-4129-a117-02cbf4f585f3 admin admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:23.563549 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853eb601-a70f-4129-a117-02cbf4f585f3 admin admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:23.570549 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d64e0-a2fc-4562-88aa-f2297dac5b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:23.571398 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d64e0-a2fc-4562-88aa-f2297dac5b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:23.572046 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d64e0-a2fc-4562-88aa-f2297dac5b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:23.572470 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d64e0-a2fc-4562-88aa-f2297dac5b9d admin admin] PATH_INFO: `/v3/projects/10b0a81f01f44fa3b9e2952a40e1ca0e/users/50d22281194448f8be1d4e3052be2a25/roles/5609ac7373ba400593bba6d811e3aa72` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:23.575106 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d64e0-a2fc-4562-88aa-f2297dac5b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=10b0a81f01f44fa3b9e2952a40e1ca0e, user_id=50d22281194448f8be1d4e3052be2a25, role_id=5609ac7373ba400593bba6d811e3aa72)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:23.584514 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d64e0-a2fc-4562-88aa-f2297dac5b9d admin admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:23.635112 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 589/1183] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Sep 13 12:16:23 2022] PUT /identity/v3/projects/10b0a81f01f44fa3b9e2952a40e1ca0e/users/50d22281194448f8be1d4e3052be2a25/roles/5609ac7373ba400593bba6d811e3aa72 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:16:23.915281 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbaadf0-6b4b-44dc-ab43-6d09c3d50542 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:23.915987 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbaadf0-6b4b-44dc-ab43-6d09c3d50542 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:23.916402 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbaadf0-6b4b-44dc-ab43-6d09c3d50542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:23.953387 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-1bbaadf0-6b4b-44dc-ab43-6d09c3d50542 None None] MFA Rules not processed for user `e953d95f49114a278036e290b92102cf`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:23.956199 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-1bbaadf0-6b4b-44dc-ab43-6d09c3d50542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:24.019886 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:24.049590 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 595/1184] 10.222.0.15 () {58 vars in 958 bytes} [Tue Sep 13 12:16:23 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:16:24.050568 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d64e0-a2fc-4562-88aa-f2297dac5b9d admin admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:24.133267 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d64e0-a2fc-4562-88aa-f2297dac5b9d admin admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:24.141656 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44739600-253e-4611-917d-347a828b5193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:24.142306 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44739600-253e-4611-917d-347a828b5193 admin admin] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:24.143153 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44739600-253e-4611-917d-347a828b5193 admin admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:24.143153 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44739600-253e-4611-917d-347a828b5193 admin admin] PATH_INFO: `/v3/projects` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:24.143713 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44739600-253e-4611-917d-347a828b5193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:24.145679 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44739600-253e-4611-917d-347a828b5193 admin admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:24.194178 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 590/1185] 10.222.0.15 () {60 vars in 1153 bytes} [Tue Sep 13 12:16:24 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 12:16:24.196759 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbaadf0-6b4b-44dc-ab43-6d09c3d50542 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:24.220106 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbaadf0-6b4b-44dc-ab43-6d09c3d50542 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:24.298003 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d44857-f087-4d2c-804c-82de802b95af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:24.298959 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d44857-f087-4d2c-804c-82de802b95af admin admin] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:24.299314 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d44857-f087-4d2c-804c-82de802b95af admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:24.299666 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d44857-f087-4d2c-804c-82de802b95af admin admin] PATH_INFO: `/v3/users` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:24.300412 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d44857-f087-4d2c-804c-82de802b95af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:24.302805 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d44857-f087-4d2c-804c-82de802b95af admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:24.343951 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 596/1186] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Sep 13 12:16:24 2022] POST /identity/v3/users => generated 295 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 12:16:24.345778 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44739600-253e-4611-917d-347a828b5193 admin admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:24.358102 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44739600-253e-4611-917d-347a828b5193 admin admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:24.364948 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99111e7f-3992-4bb5-ac98-4a2a7066b4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:24.367876 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99111e7f-3992-4bb5-ac98-4a2a7066b4db admin admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:24.367876 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99111e7f-3992-4bb5-ac98-4a2a7066b4db admin admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:24.367876 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99111e7f-3992-4bb5-ac98-4a2a7066b4db admin admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:24.367876 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99111e7f-3992-4bb5-ac98-4a2a7066b4db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:24.369283 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99111e7f-3992-4bb5-ac98-4a2a7066b4db admin admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:24.385834 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 591/1187] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Sep 13 12:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 12:16:24.389840 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d44857-f087-4d2c-804c-82de802b95af admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:24.401041 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d44857-f087-4d2c-804c-82de802b95af admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:24.407303 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb9ae0-6455-4eb3-9a66-27ec738be455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:24.408377 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb9ae0-6455-4eb3-9a66-27ec738be455 admin admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:24.413877 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb9ae0-6455-4eb3-9a66-27ec738be455 admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:24.413877 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb9ae0-6455-4eb3-9a66-27ec738be455 admin admin] PATH_INFO: `/v3/projects/004e0a380cfa43b29769afaffe6a1881/users/eb0ab4899de04a6caafaf2e1e8d12d20/roles/5609ac7373ba400593bba6d811e3aa72` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:24.458236 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb9ae0-6455-4eb3-9a66-27ec738be455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=004e0a380cfa43b29769afaffe6a1881, user_id=eb0ab4899de04a6caafaf2e1e8d12d20, role_id=5609ac7373ba400593bba6d811e3aa72)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:24.463145 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb9ae0-6455-4eb3-9a66-27ec738be455 admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:24.501203 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 597/1188] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Sep 13 12:16:24 2022] PUT /identity/v3/projects/004e0a380cfa43b29769afaffe6a1881/users/eb0ab4899de04a6caafaf2e1e8d12d20/roles/5609ac7373ba400593bba6d811e3aa72 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:16:24.505584 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99111e7f-3992-4bb5-ac98-4a2a7066b4db admin admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:24.520619 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99111e7f-3992-4bb5-ac98-4a2a7066b4db admin admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:24.630673 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d3e67-c67a-4fc2-815c-eb04fd4b1be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:24.630673 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d3e67-c67a-4fc2-815c-eb04fd4b1be7 admin admin] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:24.631083 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d3e67-c67a-4fc2-815c-eb04fd4b1be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:24.631480 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d3e67-c67a-4fc2-815c-eb04fd4b1be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:24.632561 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d3e67-c67a-4fc2-815c-eb04fd4b1be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:24.635679 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d3e67-c67a-4fc2-815c-eb04fd4b1be7 admin admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:24.653743 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 592/1189] 10.222.0.15 () {58 vars in 1122 bytes} [Tue Sep 13 12:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 12:16:24.658184 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb9ae0-6455-4eb3-9a66-27ec738be455 admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:24.679142 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb9ae0-6455-4eb3-9a66-27ec738be455 admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:24.692058 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e65ebd-9fdd-4cbd-bdc4-1e75122bf4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:24.692598 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e65ebd-9fdd-4cbd-bdc4-1e75122bf4e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:24.692866 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e65ebd-9fdd-4cbd-bdc4-1e75122bf4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:24.693208 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e65ebd-9fdd-4cbd-bdc4-1e75122bf4e7 admin admin] PATH_INFO: `/v3/projects/004e0a380cfa43b29769afaffe6a1881/users/eb0ab4899de04a6caafaf2e1e8d12d20/roles/5609ac7373ba400593bba6d811e3aa72` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:24.695468 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e65ebd-9fdd-4cbd-bdc4-1e75122bf4e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=004e0a380cfa43b29769afaffe6a1881, user_id=eb0ab4899de04a6caafaf2e1e8d12d20, role_id=5609ac7373ba400593bba6d811e3aa72)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:24.699103 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e65ebd-9fdd-4cbd-bdc4-1e75122bf4e7 admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:24.721228 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 598/1190] 10.222.0.15 () {60 vars in 1483 bytes} [Tue Sep 13 12:16:24 2022] PUT /identity/v3/projects/004e0a380cfa43b29769afaffe6a1881/users/eb0ab4899de04a6caafaf2e1e8d12d20/roles/5609ac7373ba400593bba6d811e3aa72 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:16:30.233570 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec57bd-90c7-4173-82e0-278e8a153403 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:30.234142 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec57bd-90c7-4173-82e0-278e8a153403 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:30.234440 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec57bd-90c7-4173-82e0-278e8a153403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:30.274360 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-b4ec57bd-90c7-4173-82e0-278e8a153403 None None] MFA Rules not processed for user `50d22281194448f8be1d4e3052be2a25`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:30.276478 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-b4ec57bd-90c7-4173-82e0-278e8a153403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:30.336970 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:30.383713 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 593/1191] 10.222.0.15 () {58 vars in 958 bytes} [Tue Sep 13 12:16:30 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:30.401456 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e65ebd-9fdd-4cbd-bdc4-1e75122bf4e7 admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:30.404907 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-c7e65ebd-9fdd-4cbd-bdc4-1e75122bf4e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:30.560596 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e65ebd-9fdd-4cbd-bdc4-1e75122bf4e7 admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:30.566068 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21066f9-f32d-41e2-9114-8c6203cfe8b6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e2b26fb30024905986a99000564b475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:30.566728 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21066f9-f32d-41e2-9114-8c6203cfe8b6 service glance] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:30.567827 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21066f9-f32d-41e2-9114-8c6203cfe8b6 service glance] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:30.568109 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21066f9-f32d-41e2-9114-8c6203cfe8b6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:30.651567 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:30.681220 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21066f9-f32d-41e2-9114-8c6203cfe8b6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:30.685275 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21066f9-f32d-41e2-9114-8c6203cfe8b6 service glance] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:30.715794 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 599/1192] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:16:30 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:16:31.222068 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ef56b-14f3-47e2-9723-b56e68f0d543 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:31.222359 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ef56b-14f3-47e2-9723-b56e68f0d543 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:31.222735 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014ef56b-14f3-47e2-9723-b56e68f0d543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:31.274892 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-014ef56b-14f3-47e2-9723-b56e68f0d543 None None] MFA Rules not processed for user `eb0ab4899de04a6caafaf2e1e8d12d20`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:31.277064 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-014ef56b-14f3-47e2-9723-b56e68f0d543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:31.381761 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 594/1193] 10.222.0.15 () {58 vars in 958 bytes} [Tue Sep 13 12:16:31 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:31.396409 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21066f9-f32d-41e2-9114-8c6203cfe8b6 service glance] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:31.411493 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21066f9-f32d-41e2-9114-8c6203cfe8b6 service glance] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:31.422122 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0f46d-cca7-4f0a-9225-f6f5e8128206 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e2b26fb30024905986a99000564b475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:31.424240 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0f46d-cca7-4f0a-9225-f6f5e8128206 service glance] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:31.424784 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0f46d-cca7-4f0a-9225-f6f5e8128206 service glance] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:31.425312 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0f46d-cca7-4f0a-9225-f6f5e8128206 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:31.524027 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0f46d-cca7-4f0a-9225-f6f5e8128206 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:31.526355 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0f46d-cca7-4f0a-9225-f6f5e8128206 service glance] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:31.552387 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 600/1194] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:16:31 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 12:16:39.240430 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f684683-f380-48fd-bfd2-2ca78c1268b7 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:39.241025 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f684683-f380-48fd-bfd2-2ca78c1268b7 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:39.241025 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f684683-f380-48fd-bfd2-2ca78c1268b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:39.261143 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-4f684683-f380-48fd-bfd2-2ca78c1268b7 None None] MFA Rules not processed for user `3985566453df49a7a5032b946db5fcdb`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:39.262299 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-4f684683-f380-48fd-bfd2-2ca78c1268b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:39.270304 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 595/1195] 10.222.0.15 () {58 vars in 958 bytes} [Tue Sep 13 12:16:39 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:39.574461 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededa1c3-45be-4160-9d0f-4fc3d169da1a None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:39.576032 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededa1c3-45be-4160-9d0f-4fc3d169da1a None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:39.576032 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededa1c3-45be-4160-9d0f-4fc3d169da1a None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:39.577234 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 601/1196] 10.222.0.15 () {54 vars in 962 bytes} [Tue Sep 13 12:16:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:39.585222 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77ea7e-d3ea-47a3-8e7c-903ff528be73 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:39.585717 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77ea7e-d3ea-47a3-8e7c-903ff528be73 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:39.586201 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77ea7e-d3ea-47a3-8e7c-903ff528be73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:39.622687 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-4f77ea7e-d3ea-47a3-8e7c-903ff528be73 None None] MFA Rules not processed for user `e740dc7330284b0bbe6a825186f0a55d`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:39.624054 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-4f77ea7e-d3ea-47a3-8e7c-903ff528be73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:39.722512 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 596/1197] 10.222.0.15 () {58 vars in 1059 bytes} [Tue Sep 13 12:16:39 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:39.728098 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bf967-7953-4923-9c3e-35c192b9a180 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:39.728381 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bf967-7953-4923-9c3e-35c192b9a180 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:39.728758 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5bf967-7953-4923-9c3e-35c192b9a180 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:39.730070 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 602/1198] 10.222.0.15 () {54 vars in 912 bytes} [Tue Sep 13 12:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:39.736722 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380eaefa-7d9e-4626-877e-cda08fc483d5 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:39.736722 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380eaefa-7d9e-4626-877e-cda08fc483d5 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:39.736722 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380eaefa-7d9e-4626-877e-cda08fc483d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:39.766394 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-380eaefa-7d9e-4626-877e-cda08fc483d5 None None] MFA Rules not processed for user `e740dc7330284b0bbe6a825186f0a55d`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:39.767659 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-380eaefa-7d9e-4626-877e-cda08fc483d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:39.776729 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 597/1199] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Sep 13 12:16:39 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:39.789564 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bf967-7953-4923-9c3e-35c192b9a180 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:39.792004 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-3e5bf967-7953-4923-9c3e-35c192b9a180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:39.807021 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5bf967-7953-4923-9c3e-35c192b9a180 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:39.813665 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2214c1d-b0d1-474e-847d-1a03a688f8ef service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e2b26fb30024905986a99000564b475', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:39.815093 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2214c1d-b0d1-474e-847d-1a03a688f8ef service glance] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:39.815575 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2214c1d-b0d1-474e-847d-1a03a688f8ef service glance] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:39.815920 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2214c1d-b0d1-474e-847d-1a03a688f8ef service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:39.833558 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2214c1d-b0d1-474e-847d-1a03a688f8ef service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:39.835434 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2214c1d-b0d1-474e-847d-1a03a688f8ef service glance] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:39.848143 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 603/1200] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:16:39 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:16:40.253686 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cd428-3de1-433b-b05a-38301aa05a0d None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:40.254233 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cd428-3de1-433b-b05a-38301aa05a0d None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:40.254233 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cd428-3de1-433b-b05a-38301aa05a0d None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:40.255753 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 598/1201] 10.222.0.15 () {54 vars in 912 bytes} [Tue Sep 13 12:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:40.261566 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da9d32-8ce4-4eae-9cbf-8bb3f71ea3f1 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:40.262168 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da9d32-8ce4-4eae-9cbf-8bb3f71ea3f1 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:40.262678 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da9d32-8ce4-4eae-9cbf-8bb3f71ea3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:40.290419 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-43da9d32-8ce4-4eae-9cbf-8bb3f71ea3f1 None None] MFA Rules not processed for user `2e24fc5713164917ba1368ff461e9629`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:40.292312 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-43da9d32-8ce4-4eae-9cbf-8bb3f71ea3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:40.386155 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 604/1202] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Sep 13 12:16:40 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:40.398116 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cd428-3de1-433b-b05a-38301aa05a0d None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:40.412589 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cd428-3de1-433b-b05a-38301aa05a0d None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:40.418140 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205ac7c-c0a2-4594-91e8-8fa295d17bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:40.419874 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205ac7c-c0a2-4594-91e8-8fa295d17bcc service neutron] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:40.420460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205ac7c-c0a2-4594-91e8-8fa295d17bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:40.420914 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205ac7c-c0a2-4594-91e8-8fa295d17bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:40.430399 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205ac7c-c0a2-4594-91e8-8fa295d17bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:40.432592 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205ac7c-c0a2-4594-91e8-8fa295d17bcc service neutron] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:40.447688 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 599/1203] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:16:40 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:16:40.931344 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da9d32-8ce4-4eae-9cbf-8bb3f71ea3f1 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:40.933093 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f72184-3145-4ff3-a952-ed741e82aa44 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:40.933578 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f72184-3145-4ff3-a952-ed741e82aa44 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:40.934052 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f72184-3145-4ff3-a952-ed741e82aa44 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:40.936325 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 600/1204] 10.222.0.15 () {54 vars in 962 bytes} [Tue Sep 13 12:16:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:40.942307 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0820d-006a-448e-85d7-911cdec466b5 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:40.942590 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0820d-006a-448e-85d7-911cdec466b5 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:40.942902 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0820d-006a-448e-85d7-911cdec466b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:40.965601 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-99e0820d-006a-448e-85d7-911cdec466b5 None None] MFA Rules not processed for user `e740dc7330284b0bbe6a825186f0a55d`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:40.967168 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-99e0820d-006a-448e-85d7-911cdec466b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:40.977062 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 601/1205] 10.222.0.15 () {58 vars in 1059 bytes} [Tue Sep 13 12:16:40 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:16:40.983823 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028dc588-b35c-4d11-b8b5-6216a3dbe790 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:40.984197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028dc588-b35c-4d11-b8b5-6216a3dbe790 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:40.984544 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028dc588-b35c-4d11-b8b5-6216a3dbe790 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:40.985912 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 602/1206] 10.222.0.15 () {54 vars in 912 bytes} [Tue Sep 13 12:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:40.993296 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960676c-67f1-422b-b04f-3131474585e8 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:40.993712 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960676c-67f1-422b-b04f-3131474585e8 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:40.994051 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960676c-67f1-422b-b04f-3131474585e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:41.024512 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-a960676c-67f1-422b-b04f-3131474585e8 None None] MFA Rules not processed for user `e740dc7330284b0bbe6a825186f0a55d`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:41.026648 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-a960676c-67f1-422b-b04f-3131474585e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:41.039386 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 603/1207] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Sep 13 12:16:40 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:16:41.040032 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da9d32-8ce4-4eae-9cbf-8bb3f71ea3f1 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:41.047401 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75148e9a-7f37-4c7f-a596-3b1088c33a53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72796c5d7864bd8887419c60e3bbc1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:41.048142 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75148e9a-7f37-4c7f-a596-3b1088c33a53 service placement] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:41.048495 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75148e9a-7f37-4c7f-a596-3b1088c33a53 service placement] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:41.048833 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75148e9a-7f37-4c7f-a596-3b1088c33a53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:41.050727 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-75148e9a-7f37-4c7f-a596-3b1088c33a53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:41.054602 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960676c-67f1-422b-b04f-3131474585e8 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:41.066549 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75148e9a-7f37-4c7f-a596-3b1088c33a53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:41.067514 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960676c-67f1-422b-b04f-3131474585e8 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:41.068207 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75148e9a-7f37-4c7f-a596-3b1088c33a53 service placement] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:41.071844 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1106e-6699-4ab5-8ea1-a8f477926874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:41.072462 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1106e-6699-4ab5-8ea1-a8f477926874 service neutron] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:41.072738 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1106e-6699-4ab5-8ea1-a8f477926874 service neutron] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:41.073134 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1106e-6699-4ab5-8ea1-a8f477926874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:41.081002 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:41.087035 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1106e-6699-4ab5-8ea1-a8f477926874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:41.089214 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1106e-6699-4ab5-8ea1-a8f477926874 service neutron] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:41.092991 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 605/1208] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:16:40 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:16:41.105437 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 604/1209] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:16:41 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:16:51.091103 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=95 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:51.099391 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=3 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:16:54.021433 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ede67-93b0-481b-8f0a-0c689beea88d None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:54.021972 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ede67-93b0-481b-8f0a-0c689beea88d None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:54.021972 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ede67-93b0-481b-8f0a-0c689beea88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:54.042574 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-359ede67-93b0-481b-8f0a-0c689beea88d None None] MFA Rules not processed for user `2e24fc5713164917ba1368ff461e9629`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:54.043820 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-359ede67-93b0-481b-8f0a-0c689beea88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:54.053328 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 606/1210] 10.222.0.27 () {58 vars in 1015 bytes} [Tue Sep 13 12:16:54 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:54.065532 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1106e-6699-4ab5-8ea1-a8f477926874 service neutron] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:54.073871 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1106e-6699-4ab5-8ea1-a8f477926874 service neutron] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:54.077780 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2f619-f5b7-470b-be79-8bcefaa1896a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:54.078362 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2f619-f5b7-470b-be79-8bcefaa1896a service neutron] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:54.078657 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2f619-f5b7-470b-be79-8bcefaa1896a service neutron] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:54.078937 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2f619-f5b7-470b-be79-8bcefaa1896a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:54.086360 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2f619-f5b7-470b-be79-8bcefaa1896a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:54.087799 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2f619-f5b7-470b-be79-8bcefaa1896a service neutron] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:54.096470 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 605/1211] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:16:54 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:16:54.943108 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9684f-9102-44ae-9706-2f21aa4e24d5 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:54.943442 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9684f-9102-44ae-9706-2f21aa4e24d5 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:54.943678 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9684f-9102-44ae-9706-2f21aa4e24d5 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:54.945185 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 607/1212] 10.222.0.15 () {54 vars in 921 bytes} [Tue Sep 13 12:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:16:55.019005 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04903966-1014-4d5d-85e2-bbeb9ae20c18 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:55.019221 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04903966-1014-4d5d-85e2-bbeb9ae20c18 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:55.019518 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04903966-1014-4d5d-85e2-bbeb9ae20c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:55.041830 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-04903966-1014-4d5d-85e2-bbeb9ae20c18 None None] MFA Rules not processed for user `e740dc7330284b0bbe6a825186f0a55d`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:16:55.043604 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-04903966-1014-4d5d-85e2-bbeb9ae20c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:16:55.054362 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 606/1213] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Sep 13 12:16:55 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:16:55.072876 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9684f-9102-44ae-9706-2f21aa4e24d5 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:16:55.089195 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9684f-9102-44ae-9706-2f21aa4e24d5 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:16:55.095624 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20078b7a-6dce-4120-a0c9-482605fe984a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:16:55.096231 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20078b7a-6dce-4120-a0c9-482605fe984a service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:16:55.096508 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20078b7a-6dce-4120-a0c9-482605fe984a service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:16:55.096785 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20078b7a-6dce-4120-a0c9-482605fe984a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:16:55.105881 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20078b7a-6dce-4120-a0c9-482605fe984a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:16:55.119537 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20078b7a-6dce-4120-a0c9-482605fe984a service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:16:55.132210 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 608/1214] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:16:55 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:17:02.264618 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69722e-b698-4faf-aff8-c2e77ab55fdd None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:02.265245 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69722e-b698-4faf-aff8-c2e77ab55fdd None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:02.265245 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69722e-b698-4faf-aff8-c2e77ab55fdd None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:02.266466 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 607/1215] 10.222.0.15 () {54 vars in 921 bytes} [Tue Sep 13 12:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:17:02.276051 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb6abd-eb04-42b6-9478-a7694f467212 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:02.276678 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb6abd-eb04-42b6-9478-a7694f467212 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:02.276954 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb6abd-eb04-42b6-9478-a7694f467212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:02.298410 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-80fb6abd-eb04-42b6-9478-a7694f467212 None None] MFA Rules not processed for user `e740dc7330284b0bbe6a825186f0a55d`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:02.299941 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-80fb6abd-eb04-42b6-9478-a7694f467212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:02.309040 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 609/1216] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Sep 13 12:17:02 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 12:17:02.336200 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69722e-b698-4faf-aff8-c2e77ab55fdd None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:02.357629 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69722e-b698-4faf-aff8-c2e77ab55fdd None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:02.363703 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a05f8-7708-4c3f-a675-1b6765e72bf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:02.364383 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a05f8-7708-4c3f-a675-1b6765e72bf9 service nova] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:02.364663 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a05f8-7708-4c3f-a675-1b6765e72bf9 service nova] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:02.364937 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a05f8-7708-4c3f-a675-1b6765e72bf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:02.374107 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a05f8-7708-4c3f-a675-1b6765e72bf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:02.375752 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a05f8-7708-4c3f-a675-1b6765e72bf9 service nova] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:02.385953 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 608/1217] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:17:02 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:17:12.293405 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=12 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:12.381955 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=15 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:14.481600 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb6abd-eb04-42b6-9478-a7694f467212 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:14.491498 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb6abd-eb04-42b6-9478-a7694f467212 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:14.495191 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb2074-bfcd-4bd3-9f59-919bfbdb9b8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:14.496399 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb2074-bfcd-4bd3-9f59-919bfbdb9b8a service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:14.496680 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb2074-bfcd-4bd3-9f59-919bfbdb9b8a service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:14.496947 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb2074-bfcd-4bd3-9f59-919bfbdb9b8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:14.506490 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb2074-bfcd-4bd3-9f59-919bfbdb9b8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:14.507927 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb2074-bfcd-4bd3-9f59-919bfbdb9b8a service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:14.517606 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 610/1218] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:17:14 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:17:24.513427 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=6 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:29.280815 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622af8f-33ec-44b0-8545-bd87d28b393a None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:29.281349 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622af8f-33ec-44b0-8545-bd87d28b393a None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:29.281349 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622af8f-33ec-44b0-8545-bd87d28b393a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:29.300029 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-9622af8f-33ec-44b0-8545-bd87d28b393a None None] MFA Rules not processed for user `e953d95f49114a278036e290b92102cf`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:29.301229 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-9622af8f-33ec-44b0-8545-bd87d28b393a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:29.307906 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 609/1219] 10.222.0.15 () {58 vars in 958 bytes} [Tue Sep 13 12:17:29 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:17:39.295242 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=3 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:17:55.790301 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361051f0-9186-43e0-b354-4fcf6b1f54f5 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:55.790831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361051f0-9186-43e0-b354-4fcf6b1f54f5 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:55.790909 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361051f0-9186-43e0-b354-4fcf6b1f54f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:55.810112 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-361051f0-9186-43e0-b354-4fcf6b1f54f5 None None] MFA Rules not processed for user `e953d95f49114a278036e290b92102cf`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:55.811954 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-361051f0-9186-43e0-b354-4fcf6b1f54f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:55.818831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 611/1220] 10.222.0.15 () {58 vars in 958 bytes} [Tue Sep 13 12:17:55 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:17:56.305938 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f2c94-1e69-4a64-b688-a01bd25f673e None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:56.306421 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f2c94-1e69-4a64-b688-a01bd25f673e None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:56.306506 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f2c94-1e69-4a64-b688-a01bd25f673e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:56.327570 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-bf3f2c94-1e69-4a64-b688-a01bd25f673e None None] MFA Rules not processed for user `2e24fc5713164917ba1368ff461e9629`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:17:56.328762 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-bf3f2c94-1e69-4a64-b688-a01bd25f673e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:17:56.335214 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 610/1221] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Sep 13 12:17:56 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:17:56.346348 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361051f0-9186-43e0-b354-4fcf6b1f54f5 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:17:56.355507 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361051f0-9186-43e0-b354-4fcf6b1f54f5 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:17:56.359590 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df722b-ef80-43a4-8beb-c58e731305c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:17:56.360179 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df722b-ef80-43a4-8beb-c58e731305c6 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:17:56.360456 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df722b-ef80-43a4-8beb-c58e731305c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:17:56.360723 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df722b-ef80-43a4-8beb-c58e731305c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:17:56.367913 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df722b-ef80-43a4-8beb-c58e731305c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:17:56.369505 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df722b-ef80-43a4-8beb-c58e731305c6 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:17:56.377872 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 612/1222] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:17:56 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:18:06.321821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=3 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:06.374490 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=9 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:18:10.643294 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498aa9a2-52d3-4399-9142-39180a41ac2e None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:18:10.643776 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498aa9a2-52d3-4399-9142-39180a41ac2e None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:18:10.643874 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498aa9a2-52d3-4399-9142-39180a41ac2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:18:10.663120 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-498aa9a2-52d3-4399-9142-39180a41ac2e None None] MFA Rules not processed for user `e953d95f49114a278036e290b92102cf`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:18:10.664331 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-498aa9a2-52d3-4399-9142-39180a41ac2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:18:10.672066 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 611/1223] 10.222.0.15 () {58 vars in 958 bytes} [Tue Sep 13 12:18:10 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:18:20.658140 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=3 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:10.388892 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ec257-bac4-4778-be3f-89579bd94137 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:10.389383 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ec257-bac4-4778-be3f-89579bd94137 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:10.389470 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ec257-bac4-4778-be3f-89579bd94137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:10.409029 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-7d4ec257-bac4-4778-be3f-89579bd94137 None None] MFA Rules not processed for user `e953d95f49114a278036e290b92102cf`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:19:10.410226 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-7d4ec257-bac4-4778-be3f-89579bd94137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:19:10.417033 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 613/1224] 10.222.0.15 () {58 vars in 958 bytes} [Tue Sep 13 12:19:10 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:19:20.404239 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=3 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:19:24.360487 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498aa9a2-52d3-4399-9142-39180a41ac2e None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:19:24.379799 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498aa9a2-52d3-4399-9142-39180a41ac2e None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:19:24.383442 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f44f3-31e3-4e4c-afad-71160f349859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:19:24.384041 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f44f3-31e3-4e4c-afad-71160f349859 service neutron] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:19:24.384314 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f44f3-31e3-4e4c-afad-71160f349859 service neutron] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:19:24.384585 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f44f3-31e3-4e4c-afad-71160f349859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:19:24.394106 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f44f3-31e3-4e4c-afad-71160f349859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:19:24.395574 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f44f3-31e3-4e4c-afad-71160f349859 service neutron] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:19:24.404991 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 612/1225] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:19:24 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:19:34.400658 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=10 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:20:39.375768 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ec257-bac4-4778-be3f-89579bd94137 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:20:39.397778 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ec257-bac4-4778-be3f-89579bd94137 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:20:39.402931 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7e88b-1822-4719-8579-d36d9288c4c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72796c5d7864bd8887419c60e3bbc1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:20:39.403562 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7e88b-1822-4719-8579-d36d9288c4c4 service placement] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:20:39.403822 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7e88b-1822-4719-8579-d36d9288c4c4 service placement] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:20:39.404094 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7e88b-1822-4719-8579-d36d9288c4c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:20:39.412255 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7e88b-1822-4719-8579-d36d9288c4c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:20:39.413812 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7e88b-1822-4719-8579-d36d9288c4c4 service placement] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:20:39.423708 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 614/1226] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:20:39 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:20:49.419556 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=10 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:31.261167 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f44f3-31e3-4e4c-afad-71160f349859 service neutron] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:31.281313 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f44f3-31e3-4e4c-afad-71160f349859 service neutron] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:31.286454 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912a672-eb64-4ce6-af54-31d75b516785 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:31.287078 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912a672-eb64-4ce6-af54-31d75b516785 service nova] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:31.287351 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912a672-eb64-4ce6-af54-31d75b516785 service nova] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:31.287619 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912a672-eb64-4ce6-af54-31d75b516785 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:31.295709 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912a672-eb64-4ce6-af54-31d75b516785 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:31.297517 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912a672-eb64-4ce6-af54-31d75b516785 service nova] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:31.306770 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 613/1227] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:21:31 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:21:36.029316 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938ebaa-1b6f-4434-9320-6b9d85a50433 None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:36.029797 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938ebaa-1b6f-4434-9320-6b9d85a50433 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:36.029899 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938ebaa-1b6f-4434-9320-6b9d85a50433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:36.049418 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-f938ebaa-1b6f-4434-9320-6b9d85a50433 None None] MFA Rules not processed for user `e953d95f49114a278036e290b92102cf`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:21:36.050600 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-f938ebaa-1b6f-4434-9320-6b9d85a50433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:21:36.057562 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 615/1228] 10.222.0.15 () {58 vars in 958 bytes} [Tue Sep 13 12:21:36 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:21:39.247161 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912a672-eb64-4ce6-af54-31d75b516785 service nova] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:39.255970 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912a672-eb64-4ce6-af54-31d75b516785 service nova] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:39.259563 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47df65-5381-4a73-b6a8-62d8dc14299b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:39.260155 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47df65-5381-4a73-b6a8-62d8dc14299b service neutron] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:39.260428 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47df65-5381-4a73-b6a8-62d8dc14299b service neutron] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:39.260695 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47df65-5381-4a73-b6a8-62d8dc14299b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:39.270004 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47df65-5381-4a73-b6a8-62d8dc14299b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:39.271447 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd47df65-5381-4a73-b6a8-62d8dc14299b service neutron] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:39.281672 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 614/1229] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:21:39 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:21:41.638984 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938ebaa-1b6f-4434-9320-6b9d85a50433 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:41.648967 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938ebaa-1b6f-4434-9320-6b9d85a50433 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:41.652831 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d3dde-5826-4a4e-8a90-ccded5611930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:41.653430 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d3dde-5826-4a4e-8a90-ccded5611930 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:41.653712 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d3dde-5826-4a4e-8a90-ccded5611930 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:41.653983 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d3dde-5826-4a4e-8a90-ccded5611930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:41.663548 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d3dde-5826-4a4e-8a90-ccded5611930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:41.665024 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d3dde-5826-4a4e-8a90-ccded5611930 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:41.676518 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 616/1230] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:21:41 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:21:49.277738 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=16 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:21:50.585861 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47df65-5381-4a73-b6a8-62d8dc14299b service neutron] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:50.596637 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47df65-5381-4a73-b6a8-62d8dc14299b service neutron] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:50.601606 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de7f13-fa58-4257-9c44-be875a05ffcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:50.602198 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de7f13-fa58-4257-9c44-be875a05ffcb service nova] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:50.602468 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de7f13-fa58-4257-9c44-be875a05ffcb service nova] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:50.602767 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de7f13-fa58-4257-9c44-be875a05ffcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:50.611316 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de7f13-fa58-4257-9c44-be875a05ffcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:50.612920 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de7f13-fa58-4257-9c44-be875a05ffcb service nova] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:50.623081 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 615/1231] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:21:50 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:21:51.321367 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d21e63-4f7c-4251-af3b-cab3bd9924b1 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:51.322561 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d21e63-4f7c-4251-af3b-cab3bd9924b1 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:51.323224 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d21e63-4f7c-4251-af3b-cab3bd9924b1 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:51.325516 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 617/1232] 10.222.0.15 () {54 vars in 921 bytes} [Tue Sep 13 12:21:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:21:51.347889 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857b59c-ca4b-4eef-8f6d-5e09117a2077 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:51.350755 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857b59c-ca4b-4eef-8f6d-5e09117a2077 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:51.351392 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857b59c-ca4b-4eef-8f6d-5e09117a2077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:51.430117 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-1857b59c-ca4b-4eef-8f6d-5e09117a2077 None None] MFA Rules not processed for user `e740dc7330284b0bbe6a825186f0a55d`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:21:51.431484 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-1857b59c-ca4b-4eef-8f6d-5e09117a2077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:21:51.443269 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 616/1233] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Sep 13 12:21:51 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:21:51.474102 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d21e63-4f7c-4251-af3b-cab3bd9924b1 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:51.489213 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d21e63-4f7c-4251-af3b-cab3bd9924b1 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:51.495120 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514ae4e-5c9b-4783-9cc8-93602fff58de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:51.495850 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514ae4e-5c9b-4783-9cc8-93602fff58de service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:51.496200 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514ae4e-5c9b-4783-9cc8-93602fff58de service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:51.496695 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514ae4e-5c9b-4783-9cc8-93602fff58de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:51.507582 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514ae4e-5c9b-4783-9cc8-93602fff58de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:51.509218 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514ae4e-5c9b-4783-9cc8-93602fff58de service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:51.523168 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 618/1234] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:21:51 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:21:54.296833 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857b59c-ca4b-4eef-8f6d-5e09117a2077 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:54.307613 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857b59c-ca4b-4eef-8f6d-5e09117a2077 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:54.311396 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0ff23-609b-459d-9cf5-c066d8d376fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:54.312004 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0ff23-609b-459d-9cf5-c066d8d376fb service neutron] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:54.312285 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0ff23-609b-459d-9cf5-c066d8d376fb service neutron] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:54.312621 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0ff23-609b-459d-9cf5-c066d8d376fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:54.319954 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0ff23-609b-459d-9cf5-c066d8d376fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:54.321456 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0ff23-609b-459d-9cf5-c066d8d376fb service neutron] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:54.329309 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 617/1235] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:21:54 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:21:58.629814 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514ae4e-5c9b-4783-9cc8-93602fff58de service nova] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:21:58.641081 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514ae4e-5c9b-4783-9cc8-93602fff58de service nova] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:21:58.646037 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88342408-24ac-4538-b47b-f05a28cb5ba4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:21:58.646646 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88342408-24ac-4538-b47b-f05a28cb5ba4 service nova] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:21:58.646946 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88342408-24ac-4538-b47b-f05a28cb5ba4 service nova] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:21:58.647218 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88342408-24ac-4538-b47b-f05a28cb5ba4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:21:58.656795 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88342408-24ac-4538-b47b-f05a28cb5ba4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:21:58.658714 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88342408-24ac-4538-b47b-f05a28cb5ba4 service nova] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:21:58.671016 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 619/1236] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:21:58 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:22:04.325925 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=25 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:22:06.903136 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe0f30-095e-4c31-a367-0ff71b8982ec None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:22:06.903728 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe0f30-095e-4c31-a367-0ff71b8982ec None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:22:06.903728 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe0f30-095e-4c31-a367-0ff71b8982ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:22:06.922526 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-98fe0f30-095e-4c31-a367-0ff71b8982ec None None] MFA Rules not processed for user `3985566453df49a7a5032b946db5fcdb`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:22:06.923772 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-98fe0f30-095e-4c31-a367-0ff71b8982ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:22:06.930769 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 618/1237] 10.222.0.15 () {58 vars in 958 bytes} [Tue Sep 13 12:22:06 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:22:07.517085 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0da4dd-0beb-4850-8855-f4e6e051fc27 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:22:07.517533 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0da4dd-0beb-4850-8855-f4e6e051fc27 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:22:07.517628 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0da4dd-0beb-4850-8855-f4e6e051fc27 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:22:07.519132 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 620/1238] 10.222.0.15 () {54 vars in 961 bytes} [Tue Sep 13 12:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:22:07.525538 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71277a17-1c63-48d5-b3d9-2aa966c30bbd None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:22:07.525838 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71277a17-1c63-48d5-b3d9-2aa966c30bbd None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:22:07.526113 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71277a17-1c63-48d5-b3d9-2aa966c30bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:22:07.580466 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-71277a17-1c63-48d5-b3d9-2aa966c30bbd None None] MFA Rules not processed for user `e72796c5d7864bd8887419c60e3bbc1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:22:07.581693 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-71277a17-1c63-48d5-b3d9-2aa966c30bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:22:07.592479 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 619/1239] 10.222.0.15 () {58 vars in 1058 bytes} [Tue Sep 13 12:22:07 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:22:07.600180 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0da4dd-0beb-4850-8855-f4e6e051fc27 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:22:07.608898 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=22 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:22:07.617011 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0da4dd-0beb-4850-8855-f4e6e051fc27 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:22:07.622207 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a42c6-89bb-44b2-973e-77cc4cefac26 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72796c5d7864bd8887419c60e3bbc1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:22:07.622839 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a42c6-89bb-44b2-973e-77cc4cefac26 service placement] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:22:07.623122 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a42c6-89bb-44b2-973e-77cc4cefac26 service placement] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:22:07.623391 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a42c6-89bb-44b2-973e-77cc4cefac26 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:22:07.631750 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a42c6-89bb-44b2-973e-77cc4cefac26 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:22:07.633310 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a42c6-89bb-44b2-973e-77cc4cefac26 service placement] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:22:07.644612 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 621/1240] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:22:07 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:22:17.591372 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=17 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:22:17.640554 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=5 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:22:28.129997 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71277a17-1c63-48d5-b3d9-2aa966c30bbd None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:22:28.143289 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71277a17-1c63-48d5-b3d9-2aa966c30bbd None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:22:28.148250 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d88b84-6d09-438f-94d8-d48689725bcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e740dc7330284b0bbe6a825186f0a55d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:22:28.148849 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d88b84-6d09-438f-94d8-d48689725bcf service nova] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:22:28.149129 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d88b84-6d09-438f-94d8-d48689725bcf service nova] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:22:28.149398 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d88b84-6d09-438f-94d8-d48689725bcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:22:28.158494 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d88b84-6d09-438f-94d8-d48689725bcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:22:28.160125 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d88b84-6d09-438f-94d8-d48689725bcf service nova] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:22:28.170342 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 620/1241] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:22:28 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:22:36.912202 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a42c6-89bb-44b2-973e-77cc4cefac26 service placement] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:22:36.921281 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a42c6-89bb-44b2-973e-77cc4cefac26 service placement] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:22:36.925265 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafab2e-16c7-4e17-8aa6-9c5b246819f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:22:36.925853 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafab2e-16c7-4e17-8aa6-9c5b246819f4 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:22:36.926178 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafab2e-16c7-4e17-8aa6-9c5b246819f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:22:36.926457 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafab2e-16c7-4e17-8aa6-9c5b246819f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:22:36.937546 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafab2e-16c7-4e17-8aa6-9c5b246819f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:22:36.939208 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafab2e-16c7-4e17-8aa6-9c5b246819f4 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:22:36.949656 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 622/1242] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:22:36 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:22:38.166106 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=6 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:22:46.945041 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=6 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:35.775190 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da9e5f-e194-400a-ac70-7f6a8123cacb None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:35.775710 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da9e5f-e194-400a-ac70-7f6a8123cacb None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:35.775803 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da9e5f-e194-400a-ac70-7f6a8123cacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:35.805740 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-94da9e5f-e194-400a-ac70-7f6a8123cacb None None] MFA Rules not processed for user `e953d95f49114a278036e290b92102cf`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:23:35.806977 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-94da9e5f-e194-400a-ac70-7f6a8123cacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:23:35.830568 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 621/1243] 10.222.0.15 () {58 vars in 958 bytes} [Tue Sep 13 12:23:35 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:23:36.149705 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafab2e-16c7-4e17-8aa6-9c5b246819f4 service neutron] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:23:36.163785 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafab2e-16c7-4e17-8aa6-9c5b246819f4 service neutron] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:23:36.167518 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec3604-c733-4452-9248-8f2e87ca5e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:23:36.168105 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec3604-c733-4452-9248-8f2e87ca5e84 service neutron] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:23:36.168384 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec3604-c733-4452-9248-8f2e87ca5e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:23:36.168658 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec3604-c733-4452-9248-8f2e87ca5e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:23:36.179086 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec3604-c733-4452-9248-8f2e87ca5e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:23:36.180490 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec3604-c733-4452-9248-8f2e87ca5e84 service neutron] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:23:36.188608 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 623/1244] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:23:36 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:23:45.828927 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=15 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:23:46.184849 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=8 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:13.604028 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da9e5f-e194-400a-ac70-7f6a8123cacb None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:13.605624 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-94da9e5f-e194-400a-ac70-7f6a8123cacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:13.646531 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da9e5f-e194-400a-ac70-7f6a8123cacb None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:13.650064 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20164640-db0b-4a9d-9546-c4e3b2bd4811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:13.650677 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20164640-db0b-4a9d-9546-c4e3b2bd4811 service neutron] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:13.650961 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20164640-db0b-4a9d-9546-c4e3b2bd4811 service neutron] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:13.651235 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20164640-db0b-4a9d-9546-c4e3b2bd4811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:13.728142 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20164640-db0b-4a9d-9546-c4e3b2bd4811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:13.729573 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20164640-db0b-4a9d-9546-c4e3b2bd4811 service neutron] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:13.747638 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 622/1245] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:25:17.242196 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346404da-c783-4874-ac81-63716018de60 None None] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:17.242764 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346404da-c783-4874-ac81-63716018de60 None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:17.242988 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346404da-c783-4874-ac81-63716018de60 None None] PATH_INFO: `/` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:17.244469 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 624/1246] 10.222.0.15 () {54 vars in 921 bytes} [Tue Sep 13 12:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:25:17.281598 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966c887-b1fe-4928-89eb-97bd4e7b8f30 None None] REQUEST_METHOD: `POST` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:17.282144 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966c887-b1fe-4928-89eb-97bd4e7b8f30 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:17.282297 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966c887-b1fe-4928-89eb-97bd4e7b8f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:17.323417 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.auth.core [None req-e966c887-b1fe-4928-89eb-97bd4e7b8f30 None None] MFA Rules not processed for user `e72796c5d7864bd8887419c60e3bbc1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88356) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:25:17.324807 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-e966c887-b1fe-4928-89eb-97bd4e7b8f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:17.335024 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 623/1247] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Sep 13 12:25:17 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:25:17.346522 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346404da-c783-4874-ac81-63716018de60 None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:17.360236 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346404da-c783-4874-ac81-63716018de60 None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:17.365164 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd70f28-c02b-4eb4-a2ff-7cb1d9ed86ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72796c5d7864bd8887419c60e3bbc1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:17.365756 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd70f28-c02b-4eb4-a2ff-7cb1d9ed86ee service placement] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:17.366037 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd70f28-c02b-4eb4-a2ff-7cb1d9ed86ee service placement] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:17.366310 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd70f28-c02b-4eb4-a2ff-7cb1d9ed86ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:17.375223 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd70f28-c02b-4eb4-a2ff-7cb1d9ed86ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:17.376784 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd70f28-c02b-4eb4-a2ff-7cb1d9ed86ee service placement] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:17.386928 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 625/1248] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:17 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:25:20.398382 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc49f3a-03d3-4bc7-83e5-9e69a24531d7 None None] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:20.398966 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc49f3a-03d3-4bc7-83e5-9e69a24531d7 None None] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:20.399064 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc49f3a-03d3-4bc7-83e5-9e69a24531d7 None None] PATH_INFO: `/` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:20.400388 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 624/1249] 10.222.0.15 () {54 vars in 921 bytes} [Tue Sep 13 12:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 12:25:20.409192 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683e832-73d7-4c35-9547-27f1df51fa5f None None] REQUEST_METHOD: `POST` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:20.409708 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683e832-73d7-4c35-9547-27f1df51fa5f None None] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:20.409897 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683e832-73d7-4c35-9547-27f1df51fa5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:20.429817 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.auth.core [None req-c683e832-73d7-4c35-9547-27f1df51fa5f None None] MFA Rules not processed for user `e72796c5d7864bd8887419c60e3bbc1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 12:25:20.431149 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-c683e832-73d7-4c35-9547-27f1df51fa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:20.439848 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 626/1250] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Sep 13 12:25:20 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 12:25:20.457282 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc49f3a-03d3-4bc7-83e5-9e69a24531d7 None None] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:20.471995 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc49f3a-03d3-4bc7-83e5-9e69a24531d7 None None] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:20.477559 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1074772-dff6-471e-9d6f-344f1f861ed3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72796c5d7864bd8887419c60e3bbc1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:20.478184 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1074772-dff6-471e-9d6f-344f1f861ed3 service placement] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:20.478460 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1074772-dff6-471e-9d6f-344f1f861ed3 service placement] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:20.478762 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1074772-dff6-471e-9d6f-344f1f861ed3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:20.488578 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1074772-dff6-471e-9d6f-344f1f861ed3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:20.490138 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1074772-dff6-471e-9d6f-344f1f861ed3 service placement] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:20.490874 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683e832-73d7-4c35-9547-27f1df51fa5f None None] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:20.502382 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683e832-73d7-4c35-9547-27f1df51fa5f None None] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:20.504570 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 625/1251] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:20 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:25:20.508938 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebcbf1c-28b1-4e8c-ad4c-49726f7a5e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:20.509517 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcbf1c-28b1-4e8c-ad4c-49726f7a5e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:20.509797 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcbf1c-28b1-4e8c-ad4c-49726f7a5e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:20.510071 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcbf1c-28b1-4e8c-ad4c-49726f7a5e2d admin admin] PATH_INFO: `/v3/users/3985566453df49a7a5032b946db5fcdb` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:20.511357 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebcbf1c-28b1-4e8c-ad4c-49726f7a5e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3985566453df49a7a5032b946db5fcdb)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:20.513738 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebcbf1c-28b1-4e8c-ad4c-49726f7a5e2d admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:20.568014 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-eebcbf1c-28b1-4e8c-ad4c-49726f7a5e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3985566453df49a7a5032b946db5fcdb'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.568670 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-eebcbf1c-28b1-4e8c-ad4c-49726f7a5e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3985566453df49a7a5032b946db5fcdb'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.577109 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-eebcbf1c-28b1-4e8c-ad4c-49726f7a5e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3985566453df49a7a5032b946db5fcdb'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.578692 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-eebcbf1c-28b1-4e8c-ad4c-49726f7a5e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3985566453df49a7a5032b946db5fcdb'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.591061 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-eebcbf1c-28b1-4e8c-ad4c-49726f7a5e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3985566453df49a7a5032b946db5fcdb'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.603644 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 627/1252] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Sep 13 12:25:20 2022] DELETE /identity/v3/users/3985566453df49a7a5032b946db5fcdb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:25:20.777635 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1074772-dff6-471e-9d6f-344f1f861ed3 service placement] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:20.789452 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1074772-dff6-471e-9d6f-344f1f861ed3 service placement] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:20.845965 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377a727-77ad-4439-a26a-f7c590feb5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:20.846590 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377a727-77ad-4439-a26a-f7c590feb5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:20.846982 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377a727-77ad-4439-a26a-f7c590feb5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:20.847164 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377a727-77ad-4439-a26a-f7c590feb5f8 admin admin] PATH_INFO: `/v3/projects/03879607b5104726902ffbc115fa25bd` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:20.848330 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377a727-77ad-4439-a26a-f7c590feb5f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03879607b5104726902ffbc115fa25bd)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:20.850180 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377a727-77ad-4439-a26a-f7c590feb5f8 admin admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:20.867357 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=100 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:20.901221 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-1377a727-77ad-4439-a26a-f7c590feb5f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03879607b5104726902ffbc115fa25bd', 'request_id': 'req-1377a727-77ad-4439-a26a-f7c590feb5f8'} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.907226 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-1377a727-77ad-4439-a26a-f7c590feb5f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03879607b5104726902ffbc115fa25bd', 'request_id': 'req-1377a727-77ad-4439-a26a-f7c590feb5f8'} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.915156 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-1377a727-77ad-4439-a26a-f7c590feb5f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03879607b5104726902ffbc115fa25bd', 'request_id': 'req-1377a727-77ad-4439-a26a-f7c590feb5f8'} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.938552 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-1377a727-77ad-4439-a26a-f7c590feb5f8 admin admin] The token cache is being invalidate because project 03879607b5104726902ffbc115fa25bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:25:20.938887 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-1377a727-77ad-4439-a26a-f7c590feb5f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.939521 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-1377a727-77ad-4439-a26a-f7c590feb5f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:20.941090 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 626/1253] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Sep 13 12:25:20 2022] DELETE /identity/v3/projects/03879607b5104726902ffbc115fa25bd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:25:20.945279 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebcbf1c-28b1-4e8c-ad4c-49726f7a5e2d admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:20.946738 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-eebcbf1c-28b1-4e8c-ad4c-49726f7a5e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:20.960476 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebcbf1c-28b1-4e8c-ad4c-49726f7a5e2d admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:21.018558 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b5b62-74b1-4207-ac33-21615013981d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:21.019228 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b5b62-74b1-4207-ac33-21615013981d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:21.019506 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b5b62-74b1-4207-ac33-21615013981d admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:21.019779 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b5b62-74b1-4207-ac33-21615013981d admin admin] PATH_INFO: `/v3/users/50d22281194448f8be1d4e3052be2a25` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:21.020917 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b5b62-74b1-4207-ac33-21615013981d admin admin] RBAC: Authorizing `identity:delete_user(user_id=50d22281194448f8be1d4e3052be2a25)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:21.022877 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b5b62-74b1-4207-ac33-21615013981d admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:21.069587 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-df3b5b62-74b1-4207-ac33-21615013981d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50d22281194448f8be1d4e3052be2a25'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:21.070234 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-df3b5b62-74b1-4207-ac33-21615013981d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50d22281194448f8be1d4e3052be2a25'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:21.078137 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-df3b5b62-74b1-4207-ac33-21615013981d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50d22281194448f8be1d4e3052be2a25'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:21.078809 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-df3b5b62-74b1-4207-ac33-21615013981d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50d22281194448f8be1d4e3052be2a25'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:21.079907 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:21.092984 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-df3b5b62-74b1-4207-ac33-21615013981d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50d22281194448f8be1d4e3052be2a25'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:21.104971 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 628/1254] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Sep 13 12:25:20 2022] DELETE /identity/v3/users/50d22281194448f8be1d4e3052be2a25 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:25:21.276384 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377a727-77ad-4439-a26a-f7c590feb5f8 admin admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:21.277945 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-1377a727-77ad-4439-a26a-f7c590feb5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:21.290594 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377a727-77ad-4439-a26a-f7c590feb5f8 admin admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:21.351129 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf88646-e86a-41b3-9006-284d71f93a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:21.351766 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf88646-e86a-41b3-9006-284d71f93a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:21.352025 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf88646-e86a-41b3-9006-284d71f93a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:21.352294 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf88646-e86a-41b3-9006-284d71f93a4b admin admin] PATH_INFO: `/v3/projects/10b0a81f01f44fa3b9e2952a40e1ca0e` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:21.353410 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf88646-e86a-41b3-9006-284d71f93a4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=10b0a81f01f44fa3b9e2952a40e1ca0e)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:21.355341 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf88646-e86a-41b3-9006-284d71f93a4b admin admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:21.400657 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-0cf88646-e86a-41b3-9006-284d71f93a4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10b0a81f01f44fa3b9e2952a40e1ca0e', 'request_id': 'req-0cf88646-e86a-41b3-9006-284d71f93a4b'} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:21.407284 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-0cf88646-e86a-41b3-9006-284d71f93a4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10b0a81f01f44fa3b9e2952a40e1ca0e', 'request_id': 'req-0cf88646-e86a-41b3-9006-284d71f93a4b'} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:21.414510 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-0cf88646-e86a-41b3-9006-284d71f93a4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10b0a81f01f44fa3b9e2952a40e1ca0e', 'request_id': 'req-0cf88646-e86a-41b3-9006-284d71f93a4b'} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:21.425818 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-0cf88646-e86a-41b3-9006-284d71f93a4b admin admin] The token cache is being invalidate because project 10b0a81f01f44fa3b9e2952a40e1ca0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:25:21.426100 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-0cf88646-e86a-41b3-9006-284d71f93a4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:21.426756 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-0cf88646-e86a-41b3-9006-284d71f93a4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:25:21.428207 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 627/1255] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Sep 13 12:25:21 2022] DELETE /identity/v3/projects/10b0a81f01f44fa3b9e2952a40e1ca0e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:25:31.101572 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=11,keystone:DELETE=2 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:31.422845 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=73,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:25:43.351419 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b5b62-74b1-4207-ac33-21615013981d admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:25:43.352861 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-df3b5b62-74b1-4207-ac33-21615013981d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:43.434302 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b5b62-74b1-4207-ac33-21615013981d admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:25:43.492228 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a87c2-c812-4685-baf3-9dab0c55c9be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72796c5d7864bd8887419c60e3bbc1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:25:43.492830 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a87c2-c812-4685-baf3-9dab0c55c9be service placement] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:25:43.493104 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a87c2-c812-4685-baf3-9dab0c55c9be service placement] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:25:43.493374 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a87c2-c812-4685-baf3-9dab0c55c9be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:25:43.495146 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-117a87c2-c812-4685-baf3-9dab0c55c9be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:25:43.506047 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a87c2-c812-4685-baf3-9dab0c55c9be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:25:43.507645 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a87c2-c812-4685-baf3-9dab0c55c9be service placement] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:25:43.517660 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 629/1256] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:25:43 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:25:53.513138 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=58 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:12.436253 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf88646-e86a-41b3-9006-284d71f93a4b admin admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:26:12.437686 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-0cf88646-e86a-41b3-9006-284d71f93a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:12.494288 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf88646-e86a-41b3-9006-284d71f93a4b admin admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:26:12.497730 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221222d-8b15-439b-976d-9977f7337a31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e24fc5713164917ba1368ff461e9629', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:26:12.498319 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221222d-8b15-439b-976d-9977f7337a31 service neutron] REQUEST_METHOD: `GET` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:12.498597 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221222d-8b15-439b-976d-9977f7337a31 service neutron] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:12.498900 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221222d-8b15-439b-976d-9977f7337a31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:12.500591 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-3221222d-8b15-439b-976d-9977f7337a31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:12.562776 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221222d-8b15-439b-976d-9977f7337a31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:26:12.564295 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221222d-8b15-439b-976d-9977f7337a31 service neutron] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:26:12.573637 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 628/1257] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:26:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 12:26:19.117531 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a87c2-c812-4685-baf3-9dab0c55c9be service placement] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:26:19.119887 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-117a87c2-c812-4685-baf3-9dab0c55c9be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:19.140896 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a87c2-c812-4685-baf3-9dab0c55c9be service placement] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:26:19.146280 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5fe0e-151a-4507-aeb8-998e8713cbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:26:19.146945 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5fe0e-151a-4507-aeb8-998e8713cbbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:19.147318 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5fe0e-151a-4507-aeb8-998e8713cbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:19.147530 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5fe0e-151a-4507-aeb8-998e8713cbbe admin admin] PATH_INFO: `/v3/users/e953d95f49114a278036e290b92102cf` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:19.162220 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5fe0e-151a-4507-aeb8-998e8713cbbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=e953d95f49114a278036e290b92102cf)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:26:19.164154 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5fe0e-151a-4507-aeb8-998e8713cbbe admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:26:19.211955 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-65b5fe0e-151a-4507-aeb8-998e8713cbbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e953d95f49114a278036e290b92102cf'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:26:19.212598 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-65b5fe0e-151a-4507-aeb8-998e8713cbbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e953d95f49114a278036e290b92102cf'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:26:19.220391 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-65b5fe0e-151a-4507-aeb8-998e8713cbbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e953d95f49114a278036e290b92102cf'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:26:19.221432 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-65b5fe0e-151a-4507-aeb8-998e8713cbbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e953d95f49114a278036e290b92102cf'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:26:19.234390 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-65b5fe0e-151a-4507-aeb8-998e8713cbbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e953d95f49114a278036e290b92102cf'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:26:19.247484 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 630/1258] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Sep 13 12:26:19 2022] DELETE /identity/v3/users/e953d95f49114a278036e290b92102cf => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:26:19.430243 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221222d-8b15-439b-976d-9977f7337a31 service neutron] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:26:19.440464 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221222d-8b15-439b-976d-9977f7337a31 service neutron] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:26:19.496610 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107c81e-26e1-49c5-bf25-b581d85f249b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:26:19.497268 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107c81e-26e1-49c5-bf25-b581d85f249b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:19.497545 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107c81e-26e1-49c5-bf25-b581d85f249b admin admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:19.497814 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107c81e-26e1-49c5-bf25-b581d85f249b admin admin] PATH_INFO: `/v3/projects/2fcf0fae057b491482492730be8c4ac0` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:19.507870 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107c81e-26e1-49c5-bf25-b581d85f249b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fcf0fae057b491482492730be8c4ac0)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:26:19.509760 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107c81e-26e1-49c5-bf25-b581d85f249b admin admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:26:19.552030 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:19.556463 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-d107c81e-26e1-49c5-bf25-b581d85f249b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fcf0fae057b491482492730be8c4ac0', 'request_id': 'req-d107c81e-26e1-49c5-bf25-b581d85f249b'} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:26:19.563958 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-d107c81e-26e1-49c5-bf25-b581d85f249b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fcf0fae057b491482492730be8c4ac0', 'request_id': 'req-d107c81e-26e1-49c5-bf25-b581d85f249b'} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:26:19.571500 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-d107c81e-26e1-49c5-bf25-b581d85f249b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fcf0fae057b491482492730be8c4ac0', 'request_id': 'req-d107c81e-26e1-49c5-bf25-b581d85f249b'} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:26:19.582267 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-d107c81e-26e1-49c5-bf25-b581d85f249b admin admin] The token cache is being invalidate because project 2fcf0fae057b491482492730be8c4ac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:26:19.582550 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-d107c81e-26e1-49c5-bf25-b581d85f249b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:26:19.583197 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-d107c81e-26e1-49c5-bf25-b581d85f249b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:26:19.584657 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 629/1259] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Sep 13 12:26:19 2022] DELETE /identity/v3/projects/2fcf0fae057b491482492730be8c4ac0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:26:19.588660 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5fe0e-151a-4507-aeb8-998e8713cbbe admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:26:19.590065 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-65b5fe0e-151a-4507-aeb8-998e8713cbbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:19.607924 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5fe0e-151a-4507-aeb8-998e8713cbbe admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:26:19.663816 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80996c9-44a2-49a2-992d-7cf50ea5bf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:26:19.664450 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80996c9-44a2-49a2-992d-7cf50ea5bf6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:19.664726 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80996c9-44a2-49a2-992d-7cf50ea5bf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:19.664997 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80996c9-44a2-49a2-992d-7cf50ea5bf6a admin admin] PATH_INFO: `/v3/users/eb0ab4899de04a6caafaf2e1e8d12d20` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:19.666116 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80996c9-44a2-49a2-992d-7cf50ea5bf6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb0ab4899de04a6caafaf2e1e8d12d20)` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:26:19.668044 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80996c9-44a2-49a2-992d-7cf50ea5bf6a admin admin] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:26:19.714262 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-e80996c9-44a2-49a2-992d-7cf50ea5bf6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb0ab4899de04a6caafaf2e1e8d12d20'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:26:19.714860 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-e80996c9-44a2-49a2-992d-7cf50ea5bf6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb0ab4899de04a6caafaf2e1e8d12d20'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:26:19.722199 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-e80996c9-44a2-49a2-992d-7cf50ea5bf6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb0ab4899de04a6caafaf2e1e8d12d20'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:26:19.722855 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-e80996c9-44a2-49a2-992d-7cf50ea5bf6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb0ab4899de04a6caafaf2e1e8d12d20'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:26:19.729791 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:19.736235 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.notifications [None req-e80996c9-44a2-49a2-992d-7cf50ea5bf6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb0ab4899de04a6caafaf2e1e8d12d20'} {{(pid=88357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:26:19.748933 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 631/1260] 10.222.0.15 () {58 vars in 1224 bytes} [Tue Sep 13 12:26:19 2022] DELETE /identity/v3/users/eb0ab4899de04a6caafaf2e1e8d12d20 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 12:26:19.920397 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107c81e-26e1-49c5-bf25-b581d85f249b admin admin] Authenticating user token {{(pid=88356) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:26:19.921821 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.fernet_utils [None req-d107c81e-26e1-49c5-bf25-b581d85f249b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88356) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:26:19.935805 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107c81e-26e1-49c5-bf25-b581d85f249b admin admin] Validating token access rules against request {{(pid=88356) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:26:19.992878 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103f3db-0bec-49e8-bd53-02e23590ef7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8c852aa86d546e6891e0dac7b3ec7f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99ef8d30db4a4918b2622d7bdad47c3e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88356) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:26:19.993422 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103f3db-0bec-49e8-bd53-02e23590ef7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:26:19.993697 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103f3db-0bec-49e8-bd53-02e23590ef7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:26:19.993965 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103f3db-0bec-49e8-bd53-02e23590ef7d admin admin] PATH_INFO: `/v3/projects/004e0a380cfa43b29769afaffe6a1881` {{(pid=88356) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:26:19.995090 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103f3db-0bec-49e8-bd53-02e23590ef7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=004e0a380cfa43b29769afaffe6a1881)` {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:26:19.996963 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103f3db-0bec-49e8-bd53-02e23590ef7d admin admin] RBAC: Authorization granted {{(pid=88356) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:26:20.043717 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-7103f3db-0bec-49e8-bd53-02e23590ef7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '004e0a380cfa43b29769afaffe6a1881', 'request_id': 'req-7103f3db-0bec-49e8-bd53-02e23590ef7d'} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:26:20.051070 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-7103f3db-0bec-49e8-bd53-02e23590ef7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '004e0a380cfa43b29769afaffe6a1881', 'request_id': 'req-7103f3db-0bec-49e8-bd53-02e23590ef7d'} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:26:20.058563 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-7103f3db-0bec-49e8-bd53-02e23590ef7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '004e0a380cfa43b29769afaffe6a1881', 'request_id': 'req-7103f3db-0bec-49e8-bd53-02e23590ef7d'} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:26:20.069048 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-7103f3db-0bec-49e8-bd53-02e23590ef7d admin admin] The token cache is being invalidate because project 004e0a380cfa43b29769afaffe6a1881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88356) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 12:26:20.069346 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-7103f3db-0bec-49e8-bd53-02e23590ef7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:26:20.070019 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG keystone.notifications [None req-7103f3db-0bec-49e8-bd53-02e23590ef7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88356) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 12:26:20.071584 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: [pid: 88356|app: 0|req: 630/1261] 10.222.0.15 () {58 vars in 1233 bytes} [Tue Sep 13 12:26:19 2022] DELETE /identity/v3/projects/004e0a380cfa43b29769afaffe6a1881 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 12:26:29.745645 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG dbcounter [-] [88357] Writing DB stats keystone:SELECT=8,keystone:DELETE=1 {{(pid=88357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:26:30.065872 dv-osbrick-857347-1-ceph devstack@keystone.service[88356]: DEBUG dbcounter [-] [88356] Writing DB stats keystone:SELECT=59,keystone:DELETE=11,keystone:INSERT=2 {{(pid=88356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 12:30:47.349347 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80996c9-44a2-49a2-992d-7cf50ea5bf6a admin admin] Authenticating user token {{(pid=88357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 12:30:47.350823 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-e80996c9-44a2-49a2-992d-7cf50ea5bf6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:30:47.428524 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80996c9-44a2-49a2-992d-7cf50ea5bf6a admin admin] Validating token access rules against request {{(pid=88357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 12:30:47.490411 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e60d21-9da9-4a23-9467-a7f49ab0ed43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e72796c5d7864bd8887419c60e3bbc1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cd599a81e8043bebfca960673e63bbc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 12:30:47.491050 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e60d21-9da9-4a23-9467-a7f49ab0ed43 service placement] REQUEST_METHOD: `GET` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 12:30:47.491328 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e60d21-9da9-4a23-9467-a7f49ab0ed43 service placement] SCRIPT_NAME: `/identity` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 12:30:47.491599 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e60d21-9da9-4a23-9467-a7f49ab0ed43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 12:30:47.493406 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.fernet_utils [None req-27e60d21-9da9-4a23-9467-a7f49ab0ed43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 12:30:47.504621 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e60d21-9da9-4a23-9467-a7f49ab0ed43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 12:30:47.506191 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e60d21-9da9-4a23-9467-a7f49ab0ed43 service placement] RBAC: Authorization granted {{(pid=88357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 12:30:47.516363 dv-osbrick-857347-1-ceph devstack@keystone.service[88357]: [pid: 88357|app: 0|req: 632/1262] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Sep 13 12:30:47 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)